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ABSTRACT 


The  purpose  of  this  thesis  is  to  develop  a  textbook  which  presents  basic  concepts 
of  matrix  algebra  from  a  primarily  computational  perspective,  for  an  introductory  course  in 
matrix  algebra  at  the  Naval  Postgraduate  School  (NPS).  The  need  for  an  introductory  matrix 
algebra  text  is  generated  by  the  unique  characteristics  of  the  student  body  at  NPS.  Students 
at  NPS  are  beginning  graduate  studies  after  several  years  away  form  the  academic  environ¬ 
ment.  As  a  result,  most  students  benefit  from  a  course  which  presents  fundamental  concepts 
and  techniques  in  solving  matrix  algebra  problems  which  are  needed  for  advanced  studies 
in  mathematics,  engineering,  and  operations  research.  Current  publications  in  matrix  al¬ 
gebra  go  into  more  detail  on  linear  algebra  than  is  needed  for  the  introductory  course  and 
many  texts  do  not  cover  complex  numbers  in  sufficient  detail  to  meet  the  needs  of  the  stu¬ 
dents.  This  text  presents  techniques  for  solving  systems  of  linear  equations,  the  algebra  of 
matrices,  the  connection  between  linear  systems  and  algebraic  operations  on  matrices,  and 
an  introduction  to  eigenvalues,  eigenvectors,  and  complex  numbers.  The  intent  is  to  home 
student  skills  in  applying  fundamental  techniques  in  matrix  algebra  essential  to  success  in 
future  courses. 
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1.  MATRIX  ALGEBRA 


Matrix  algebra  is  the  study  of  algebraic  operations  on  matrices  and  their  applications 
to  solving  systems  of  linear  equations.  Systems  of  linear  equations  occur  in  fields  such  as 
engineering,  economics,  sociology  and  the  physical  sciences.  We  need  to  understand  the 
fundamentals  of  matrix  algebra  in  order  to  solve  systems  of  linear  equations  which  make 
up  a  large  percentage  of  mathematical  problems  in  these  fields.  Because  of  the  wide  range  of 
di  sciplines  which  require  the  understanding  and  ability  to  apply  the  basic  concepts  of  matrix 
algebra,  a  need  exists  for  a  manual  to  accompany  a  course  which  presents  the  basic  concepts 
from  a  computational  perspective  rather  than  the  more  in-depth  theoretical  approach  of 
current  publications.  Students  from  different  disciplines  can  use  this  text  to  learn  the  basic 
tools  of  matrix  algebra  and  begin  applying  those  tools  immediately.  Those  students  who 
require  a  more  in-depth  understanding  of  the  subject  of  matrix  algebra  will  benefit  from 
a  clear  understanding  of  the  fundamentals  presented  in  this  manual  and  will  be  prepared 
for  follow-on  courses.  This  thesis  project  provides  a  textbook  which  presents  techniques 
for  solving  systems  of  linear  equations,  the  algebra  of  matrices,  the  connection  between 
linear  systems  and  algebraic  operations  on  matrices,  and  an  introduction  to  eigenvalues, 
eigenvectors  and  complex  numbers. 

Chapter  One  of  the  text  begins  with  methods  for  solving  homogeneous  and  nonho- 
mogeneous  systems  of  linear  equations.  The  methods  presented  are  substitution,  Gaussian 
elimination,  and  Gauss-Jordan  elimination.  In  the  process  of  learning  to  solve  linear  sys¬ 
tems  students  learn  the  three  types  of  solutions  a  linear  system  can  have,  the  representation 
of  a  linear  system  as  an  augmented  matrix,  the  row  echelon  and  reduced  row  echelon  forms 
of  a  matrix,  and  elementary  row  operations.  The  first  chapter  concludes  with  a  look  at  the 
use  of  computers  and  the  need  to  understand  types  of  computer  error  in  solving  systems  of 
linear  equations. 

In  Chapter  Two,  the  student  is  introduced  to  the  algebra  of  vectors  and  matrices. 
Students  learn  to  add,  subtract,  and  multiply  vectors  and  matrices.  Using  the  dot  product  of 
vectors,  the  student  can  compute  the  magnitude  of  a  vector  and  apply  the  Law  of  Cosines 
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to  compute  the  angle  between  two  vectors.  Additionally,  some  properties  of  matrices  are 
given  along  with  an  explanation  of  what  it  means  for  a  matrix  to  be  square,  symmetric,  or 
a  transpose  of  another  matrix.  The  techniques  learned  in  Chapters  One  and  Two  are  used  in 
Chapter  Three. 

The  connection  between  linear  systems  and  algebraic  operations  on  matrices  is  made 
in  Chapter  Three.  This  chapter  also  includes  the  concept  of  a  linear  combination  of  vec¬ 
tors  and  how  a  linear  combination  applies  to  the  definition  of  the  span  of  a  set  of  vectors. 
The  next  topic  of  discussion  is  linear  dependence  of  vectors.  The  student  learns  how  to 
determine  the  linear  dependence  relationship  in  a  set  of  vectors  using  the  solution  to  the 
homogeneous  system  of  linear  equations.  The  chapter  concludes  with  the  study  of  ma¬ 
trix  transformations  and  the  necessary  conditions  for  a  matrix  transformation  to  be  a  linear 
transformation. 

Elementary  matrices  are  presented  and  applied  in  Chapter  Four  to  motivate  the  con¬ 
cept  of  the  inverse  of  a  matrix  and  the  factorization  of  a  matrix  into  a  lower  and  an  upper 
triangular  matrix,  known  as  LU  Decomposition.  Using  the  inverse  and  the  LU  Decompo¬ 
sition  of  a  matrix,  the  student  learns  two  additional  methods  for  solving  a  system  of  linear 
equations.  The  next  topic  is  to  characterize  a  matrix  as  singular  or  nonsingular  by  calculat¬ 
ing  the  determinant  of  a  matrix.  The  methods  for  calculating  the  determinant  use  elementary 
row  operations  and  cofactor  expansion.  The  chapter  closes  with  the  use  of  the  determinant 
of  a  matrix  in  Cramer’s  Rule  to  find  the  solution  to  a  linear  system. 

The  final  chapter  of  the  text  presents  the  idea  of  eigenvalues  and  eigenvectors  of 
a  matrix.  The  procedure  of  solving  the  characteristic  equation  is  used  to  find  the  eigen¬ 
values  of  a  matrix,  and  the  eigenvectors  are  found  by  solving  the  homogeneous  system 
(A  —  XI)  X  =  0.  Since  the  eigenvalues  and  eigenvectors  can  be  real  or  complex,  the  text 
then  defines  the  set  of  complex  numbers  and  the  rules  of  arithmetic  for  complex  numbers. 

The  text  is  designed  with  examples  worked  out  in  detail  for  each  new  concept  pre- 
sentedt  Additionally^  applications  based  on  simplified  models  of  real  world  situations  are 
presented  early  in  the  text  to  show  relevance  of  the  material.  Each  chapter  concludes  with 
exercises  to  practice  the  techniques  taught.  Solutions  to  exercises  are  in  the  appendix. 

This  manual  incorporates  concepts  from  several  different  texts,  published  and  un- 
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published.  Specifically,  network  applications  adapted  from  Leon  [Ref  1],  illustrations  of 
ill-conditioned  systems  from  Rasmussen  [Ref.  2],  applications  for  eigenvalues  and  eigen¬ 
vectors  from  Underwood  [Ref.  3],  exercises  which  clearly  demonstrate  key  points  about 
the  span  of  a  set  of  vectors  and  linear  transformations  adapted  from  Lay  [Ref  4],  and  im¬ 
portant  concepts  involving  elementary  matrices  from  Anton  [Ref  5].  Reference  to  these 
sources  may  clarify  points  that  are  not  obvious  otherwise. 

The  study  of  matrix  algebra  is  far  more  involved  than  the  ideas  presented  in  this 
manual.  The  intent  of  the  text  is  specific:  to  provide  students  with  the  fundamental  tools  of 
matrix  algebra  essential  to  success  in  follow-on  courses. 
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PREFACE 


The  writing  of  this  text  is  motivated  by  the  need  for  a  manual  to  accompany  a  course 
which  presents  basic  concepts  in  linear  algebra  from  a  primarily  computational  perspective. 
The  intent  is  to  provide  students  with  the  building  blocks  and  tools  required  for  follow-on 
courses. 

The  audience  is  assumed  to  include  a  mix  of  math  students,  operations  research 
students,  and  engineering  students.  Upon  completion  of  the  text,  students  are  prepared  to 
pursue  courses  of  study  which  provide  more  advanced  topics  and  theory  such  as  linear  al¬ 
gebra,  and  courses  which  expand  on  the  concepts  taught  and  present  nontrivial  applications 
such  as  linear  programming,  differential  equations,  and  introductory  engineering  courses. 

The  author  assumes  students  are  familiar  with  algebra  with  respect  to  functions  and 
first  degree  polynomial  multiplication. 

The  text  is  designed  with  examples  for  each  new  concept  which  are  worked  out 
in  detail  so  that  the  student  should  have  no  trouble  reading  and  understanding  the  process 
followed  to  obtain  the  solution.  Applications  are  presented  in  various  sections  to  introduce 
the  material  to  be  studied  and  to  show  relevant  application  of  the  material.  The  applications 
tend  to  be  based  on  simplified  models  of  real  world  situations  because  no  familiarity  with 
calculus  or  differential  equations  is  assumed.  Each  chapter  concludes  with  exercises  to 
practice  the  concepts  taught.  Most  of  the  exercises  are  numerical  rather  than  theoretical. 
Solutions  for  all  exercises  are  at  the  end  of  the  text. 

We  begin  in  Chapter  1  with  an  introduction  to  methods  for  solving  linear  equations 
and  systems  of  linear  equations.  The  methods  introduced  are  substitution,  Gaussian  elimi¬ 
nation,  and  Gauss- Jordan  elimination.  In  Chapter  2  the  student  is  introduced  to  the  algebra 
of  vectors  and  matrices.  Additionally,  some  special  matrices  are  presented.  The  connection 
between  linear  systems  and  algebraic  operations  on  matrices  is  made  in  Chapter  3.  We  also 
consider  the  concepts  of  linear  combination,  linear  independence,  and  linear  transforma¬ 
tion.  In  Chapter  4  we  introduce  elementary  matrices,  and  use  them  to  motivate  the  concept 
of  the  inverse  of  a  matrix  and  the  standard  matrix  factorization  in  the  form  of  LU  decom- 
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position.  The  chapter  concludes  with  methods  for  finding  the  determinant  of  a  matrix  and 
some  basic  properties  of  the  determinant.  The  final  chapter,  Chapter  5,  provides  a  brief  in¬ 
troduction  to  the  concept  of  eigenvalues  and  eigenvectors  and  includes  the  study  of  complex 
numbers  so  that  the  student  can  explore  complex  eigenvalues  and  eigenvectors. 

The  material  in  this  text  can  be  covered  in  approximately  22  lecture  hours. 

Suggested  Syllabus: 


Chapter  1 

Sections  A-F 

4  lectures 

Chapter  2 

Sections  A-B 

3  lectures 

Chapter  3 

Sections  A-D 

4  lectures 

Chapter  4 

Sections  A-D 

6  lectures 

Chapter  5 

Sections  A-E 

5  lectures 

Total  lecture  hours;  22 
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I.  SYSTEMS  OF  LINEAR  EQUATIONS 


A  large  percentage  of  problems  encountered  in  mathematics  involve  solving  sys¬ 
tems  of  linear  equations.  Systems  of  linear  equations  also  have  applications  in  economics, 
industry,  physical  sciences,  sociology  and  many  other  disciplines.  This  section  will  intro¬ 
duce  nonhomogeneous  and  homogeneous  systems  of  linear  equations  and  three  methods  for 
solving  systems  of  linear  equations.  We  can  use  systems  of  linear  equations  to  model  real 
world  problems.  We  begin  with  a  simplified  application  of  linear  systems  to  the  personnel 
staffing  problem. 

Part  of  the  management  process  in  military  organizations  involves  staffing.  With  the 
current  reduction  of  forces,  most  military  units  are  faced  with  a  shortage  of  personnel.  Com¬ 
manders  must  organize  their  units  to  promote  maximum  productivity  while  operating  under 
personnel  constraints.  The  personnel  shortage  is  compounded  by  unforecast  requirements, 
such  as  the  need  for  a  Crisis  Action  Team. 

Suppose  a  Crisis  Action  Team  is  needed  to  continually  monitor  and  report  on  the 
tactical  situation  in  an  area  of  interest.  The  personnel  who  will  make  up  this  team  must 
be  taken  out  of  existing  departments;  no  new  personnel  are  added  to  the  organization.  The 
commander  wants  to  have  the  smallest  team  possible  while  still  meeting  the  requirement 
that  the  team  provide  accurate  and  timely  intelligence  assessments  of  the  situation  in  the  area 
of  interest.  The  commander  decides  to  make  a  four-shift  rotation  schedule.  The  first  shift 
is  2400  -  0600  hours.  The  second  shift  is  0600-1200  hours.  The  third  shift  is  1200-1800 
hours.  The  fourth  shift  is  1800-2400  hours.  Each  team  member  will  work  two  consec¬ 
utive  shifts  and  have  the  next  two  consecutive  shifts  off  (twelve  hours  on,  twelve  hours 
off).  Additionally,  the  commander  decides  each  shift  must  have  a  least  number  of  person¬ 
nel  working  to  complete  all  tasks.  The  minimal  staffing  numbers  are  shown  in  Table  1, 
We  can  develop  a  mathematical  model  to  help  the  commander  decide  how  many  personnel 
should  begin  working  each  shift  so  that  shift  staffing  requirements  are  met  while  using  the 
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Shift 

Number  of  Personnel  Required 

2400-0600  hours 

4 

0600-1200  hours 

6 

1200-1800  hours 

8 

1800-2400  hours 

6 

Table  1.  Crisis  Action  Team  Staffing  Requirements 


minimum  number  of  personnel.  The  variables  are  defined  below: 

w  is  the  number  of  personnel  who  begin  working  at  2400 
X  is  the  number  of  personnel  who  begin  working  at  0600 
y  is  the  number  of  personnel  who  begin  working  at  1200 
^  is  the  number  of  personnel  who  begin  working  at  1800. 

Since  we  know  the  minimal  shift  staffing  requirements,  we  can  begin  to  formulate  the  equa¬ 
tions  in  the  model.  The  personnel  working  during  the  2400-0600  shift  will  be  those  who 
begin  working  at  1 800  and  those  who  begin  at  2400.  There  must  be  at  least  four  personnel 
on  duty  from  2400-0600  hours,  so  the  first  equation  will  be: 

#  who  begin  working  at  1800  -1-  #  who  begin  working  at  2400  =  #  from  2400-0600 

z  +  w  =  4. 

The  second  equation  will  be: 

#  who  begin  working  at  2400  +  #  who  begin  working  at  0600  =  #  from  0600-1200 

w  +  X  = 

The  third  equation  will  be: 

#  who  begin  working  at  0600  +  #  who  begin  working  at  1200  =  #  from  1200-1800 


x  +  y  =  8. 

The  fourth  equation  will  be: 

#  who  begin  working  at  1200  -f  #  who  begin  working  at  1800  =  #  from  1800-2400 

y  +  z  =  6. 
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We  can  solve  these  four  equations  simultaneously: 

z  +  w  =  4 

w  +  X  —  6 

X  +  y  =  8 

y  +  z  =  6. 

Solve  for  y  in  terms  of  2:  in  the  fourth  equation: 

y  =  8-z. 

Substitute  for  y  in  the  third  equation  and  solve  for  x  in  terms  of  2  : 

X-\r^  —  Z  =  8 

X  =  z  +  2. 

Substitute  for  x  in  the  second  equation  and  solve  for  w  in  terms  ofz: 

w  +  z  +  2  =  6 

w  =  -z  +  4. 

Substitute  for  w  in  the  first  equation  and  solve  for  2  : 

z  +  {-z  +  4)  =  4 
4  =  4. 

This  last  equation  is  true  for  any  value  of  2:.  We  have  defined  each  variable  in  terms  of 

w  =  —z  +4 
X  =  z+2 

r/  =  -z  +  6 
2:  =  z. 

Since  z  is  the  number  of  personnel  who  begin  working  at  1800,  z  can  be  1,2, 3, 4, 5,  or 
6.  We  will  not  try  any  values  larger  than  6  because  the  requirement  is  for  6  personnel  on 
duty  from  1800  —  2400.  The  commander  will  minimize  personnel  usage  if  the  number  of 
personnel  beginning  work  at  1800,z,  is  4, 5, or  6.  The  negative  values  for  w  are  disregarded 
because  we  cannot  have  a  negative  number  of  people.  The  commander  can  now  make  a 
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If  z  is 

1 

2 

3 

4 

5 

6 

Then  x  is 

3 

4 

5 

6 

7 

8 

yis 

5 

4 

3 

2 

1 

0 

w  is 

3 

2 

1 

0 

-1 

-2 

Total  personnel  required 

11 

10 

9 

8 

8 

8 

Table  2.  Staffing  Options 


decision  about  how  to  schedule  the  rotation  of  personnel. 

In  reality,  the  commander  would  consider  other  factors,  such  as  overlap  of  personnel 
on  shifts  to  maintain  operational  continuity.  This  is  a  simplified  example  of  how  we  can 
begin  to  solve  real  world  issues  by  modeling  the  situation  as  a  systems  of  linear  equations. 
Let’s  find  out  what  systems  of  linear  equations  are.  We  begin  with  linear  equations. 


A.  LINEAR  EQUATIONS 

A  linear  equation  is  an  equation  which  can  be  written  in  the  form: 


aiXi  +  0^X2  -I - h  anXn  =  b, 

where  aj, On  and  b  are  real  numbers,  and  oii,  are  variables.  An  equation  of  this 
form  is  linear  if; 

1 .  Every  variable  occurs  to  the  first  power. 

2.  No  variable  of  the  form  a:',where  c  is  a  constant  not  equal  to  one. 

3.  There  are  no  products  of  variables. 

4.  No  variables  are  arguments  for  radical,  exponential,  logarithmic,  or  trigono¬ 
metric  functions. 


Example  1.1  The  following  are  linear  equations: 

3x  +  4y  =  7,  xi  +  2x2  —  Xs  =  \/8, 


llx  —  26y  +  z  =  is  a  constant),  8a)  -f  Gy  —  5  =  472:. 
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Example  1.2  The  following  are  nonlinear  equations: 

2x‘^  +  7y  =  7,  3x  2y  —  xz  =  4, 

sina;  +  y  =  0,  ^/x  +  2y  =  1. 

Consider  linear  equations  in  different  dimensions.  In  one  dimension,  a  linear  equa¬ 
tion  has  the  form: 

ax  =  b,  (I.l) 

where  a  and  b  are  real  numbers.  If  a  =  0  and  6  7^  0,  this  implies  that  I.l  has  no  solution.  If 
a  =  0  and  6  =  0,  this  implies  that  1. 1  has  infinitely  many  solutions. 

Example  1.3  Consider  the  equations: 

Ox  =  7  and  Ox  =  0. 

The  equation  Oa;  =  7  has  no  solution  because  no  matter  what  x  we  choose,  0  7^  7.  The 
equation  Oa:  =  0  has  infinitely  many  solutions  because  any  value  we  choose  for  x  will  yield 
the  result  0  =  0. 

In  the  plane,  a  linear  equation  has  the  form: 

ax-\-hy  =  c, 

where  a,  6, and  c  are  real  numbers.  In  three  dimensions,  a  linear  equation  has  the  form: 

ax  +  by  +  cz  =  d, 

where  a,  b,  c,  and  d  are  real  numbers.  In  general,  a  linear  equation  has  the  form: 

aiXi  +  a2X2  +  •  •  •  4-  anXn  .=  6, 
where  ai, ...,  a„,  and  b  are  real  numbers. 

A  solution  to  a  linear  equation  a\X\  -I-  a2X2  -I-  •  •  •  -I-  dn^n  =  6  is  a  sequence  of 
numbers  (si,  S2, ...,  s„)  such  that  the  equation  a^x^  02X2  -1-  •  •  •  -1-  d^Xn  =  6  is  true  when 
we  substitute  the  values  si ,  S2, ...,  for  the  variables  Xi,X2, ...,  x^,  respectively.  Solving  a 
linear  equation  means  finding  all  such  solutions.  The  set  of  all  solutions  is  the  solution  set. 
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Example  1.4  Find  the  solution  set  for  the  linear  equation: 

6x  —  7y  =  3. 

Solution: 

The  general  solution  is  represented  by  the  following  equations: 


For  the  solution  we  assign  an  arbitrary  value  to  y  and  solve  for  x.  The  parameter  t  is  an 
arbitrary  real  number.  Each  solution  to  the  linear  equation  is  uniquely  determined  as  t  varies 
over  all  possible  real  numbers. 

Example  1.5  Find  the  general  solution  for  the  linear  equation: 

2x  +  Ay  —  7z  =  8. 

Solution: 

The  general  solution  is  represented  by  the  following  equations: 

f  X  =  — 2s  +  +  4 

<  y  =  s 

[  Z  =  t. 

Assign  parameters  s  and  t  to  the  variables  y  and  2:, respectively,  and  solve  for  x. 

B.  SYSTEMS  OF  LINEAR  EQUATIONS 

A  system  of  linear  equations  (linear  system)  is  a  finite  set  of  one  or  more  linear 
equations  with  the  same  variable  set.  An  m  x  n  system  of  linear  equations  is  a  linear 
system  of  m  equations  in  n  unknowns  of  the  form: 

auxi  +  ai2X2  H - 1-  ai„a:„  =  61 

<^21^1  +  0,22X2  4-  •  •  ■  +  a2nXn  =  62 

.c  J 

OmlXi  +  0^2X2  +  •  •  •  +  OmnXfi  —  ^m- 

The  aifs  (the  coefficients)  and  the  k’s  are  real  numbers.  The  x(s  are  the  variables. 
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Example  1.6  An  example  of  a  2  x  2  system  of  linear  equations,  2  equations  in  2  unknowns, 
is: 

Xi  +  2a;2  =  5 

2xi  3x2  —  8. 

Example  1.7  An  example  of  a  2  x  3  system  of  linear  equations,  2  equations  in  3  unknowns, 
is: 

5a;i  —  X2  +  10a:3  =  3 

4:Xi  2x2  "I"  8x3  =  — 1. 

A  solution  to  a  linear  system  is  a  sequence  of  numbers  (sj,  $2, Sn)  which  simul¬ 
taneously  satisfies  each  linear  equation  in  the  system  of  linear  equations  when  we  substitute 
the  values  si,  S2,  -  ,  Sn  for  the  variables  xi,X2,  ...,Xn,in  this  order.  Solving  a  system  of  lin¬ 
ear  equations  means  finding  all  such  solutions.  The  solution  set  is  the  set  of  all  possible 
solutions. 

Example  1.8  Consider  the  linear  system: 

—2xi  —  3x2  —  15xs  =  7 

T  2x2  "f  18x3  =  — 8. 

(1)  2,  —1)  is  a  solution  to  this  linear  system  because  the  values  simultaneously  satisfy  each 
equation  in  the  system.  The  values  (1,7, -2)  satisfy  the  first  equation,  but  they  do  not 
satisfy  the  second  equation;  therefore,  (1, 7,  -2)  is  not  a  solution  to  the  linear  system.  The 
general  solution  is  represented  by  the  equations: 

(  xi  =  _12/7s-5/7 
I  X2  =  -27/75-13/7 
I  ics  =  s. 


A  system  of  linear  equations  is  said  to  be  consistent  if  there  exists  at  least  one  so¬ 
lution  to  the  system.  If  no  solution  exists,  the  system  is  inconsistent.  There  are  three  possi¬ 
bilities  for  solution  sets  to  linear  systems: 

1 .  No  solution. 

2.  A  unique  solution. 

3.  Infinitely  many  solutions. 

To  visualize  these  possibilities  in  the  rcy-plane,  consider  that  a  solution  to  a  system 
of  linear  equations  is  a  point  of  intersection  of  the  lines  represented  by  the  linear  equations 
in  the  system. 
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Example  1.9  A  2  x  2  system  with  no  solution;  see  figure  1. 

A  linear  system  with  two  linear  equations  in  two  variables  can  have  no  solution  if 
the  two  lines  are  parallel.  Consider  the  system  given  by: 


xi  +  2x2  =  5 
X\  -|-  2x2  ~  7. 


Solution: 


Figure  1.  No  Solution 


Solve  for 

Substitute  into  the  second  equation: 


a^i  =  5  —  2x2. 


5  —  2x2  +  2x2  =  7 
5  =  7. 

The  last  equation  is  not  true;  therefore,  the  system  is  inconsistent. 

Example  1.10  A  2  x  2  system  with  one  solution;  see  figure  2. 

A  linear  system  with  two  linear  equations  in  two  variables  has  exactly  one  solution 
when  the  lines  in  the  system  intersect  at  a  single  point.  For  instance,  consider  the  system: 

6xi  +  2x2  =  10 
2xi  +  X2  =  2. 


Solution: 


8 


20 

15 

- 

10 

■  ,  6*x1+2*x2=10 

5 

0 

2*x1+x2=2 

-5 

-10 

5  0  5 

Figure  2.  One  Solution 

Solve  the  first  equation  for  xi. 

1  5 

a:i  =  --X2  + 

Substitute  the  resulting  expression  into  the  second  equation; 


Solve  for  x\: 


X2  =  -4. 


-  +  5 

Xi  =  3. 

This  linear  system  is  the  intersection  of  two  lines  at  a  single  point.  The  system  has  the 
unique  solution  (a;i,a;2)  =  (3,  —4) . 

Example  1.11  A  2  x  2  system  with  infinitely  many  solutions;  see  figure  3. 


A  linear  system  with  two  equations  in  two  variables  has  infinitely  many  solutions 
when  the  lines  coincide.  For  example,  consider  the  system: 

xi  +  2x2  =  5 

2xi  +  4x2  —  10. 
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Solution: 


Figure  3.  Infinitely  Many  Solutions 


Solve  for  xi  in  the  first  equation: 

xi  =  -2x2  +  5. 

Substitute  into  the  second  equation: 

2  (  2x2  H~  5)  43^2  =  10 

—4x2  +  10  +  4x2  =  10 

10  =  10.  • 

The  last  equation  is  true  for  any  value  assigned  to  X2;  the  linear  system  is  consistent. 

We  can  visualize  the  three  types  of  solutions  to  systems  of  linear  equations  as  an 
intersection  of  hyperplanes.  Each  linear  equation  in  our  system  represents  a  hyperplane. 
In  a  hyperplane  is  a  line.  In  a  hyperplane  is  a  plane.  In  i?”  we  cannot  visualize  a 
hyperplane,  but  the  concept  is  similar  to  that  of  a  plane  in  and  a  line  in  R"^. 

A  system  of  linear  equations  is  overdetermined  if  the  number  of  equations  is  greater 
than  the  number  of  variables.  Overdetermined  linear  systems  are  usually  inconsistent;  how¬ 
ever,  it  is  possible  for  an  overdetermined  linear  system  to  be  consistent. 

Example  1.12  Consider  the  overdetermined  linear  system: 


10 


Xi  4-  2x2  +  X3 

3xi  —  X2  —  Xz 

5x^  +  3x2  +  X3 

4;Xx  -j-  6x2  4"  4x3 

The  general  solution  for  this  linear  system  is: 

a;i  =  l/7s  +  16/7 
^2  =  -4/7s  +  13/7 

X3  =  s. 

This  overdetermined  linear  system  is  consistent  because  two  of  the  linear  equations  in  the 
system  are  multiples  of  the  other  two  equations  in  the  system. 

Similarly,  a  system  of  linear  equations  is  underdetermined  when  the  number  of 
equations  is  less  than  the  number  of  variables.  Underdetermined  linear  systems  are  usu¬ 
ally  consistent  with  infinitely  many  solutions.  It  is  not  possible  for  the  underdetermined 
system  to  have  a  unique  solution,  because  there  will  always  be  a  free  variable.  It  is  possi¬ 
ble  for  an  underdetermined  system  to  be  inconsistent. 


=  6 
=  5 

=  17 
=  2. 


C.  METHODS  FOR  SOLVING  LINEAR  SYSTEMS 

Many  methods  for  solving  systems  of  linear  equations  exist.  In  this  section  we  will 
study  three  methods:  Method  of  Substitution,  Gaussian  Elimination  with  Back  Substitution, 
and  Gauss-Jordan  Elimination. 

1.  Method  of  Substitution 

Solving  a  system  of  linear  equations  by  the  method  of  substitution  is  the  process 
of  solving  for  any  one  variable  in  terms  of  the  other  variables  and  substituting  into  the 
remaining  equations.  The  method  of  substitution  is  frequently  used  when  solving  relatively 
small  systems  of  linear  equations,  but  this  method  soon  becomes  cumbersome  as  the  size 
of  the  linear  system  increases.  The  procedure  is  basic: 

1.  Eliminate  variables  by  defining  a  variable  in  terms  of  other  variables  in  the 

system. 
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2.  Substitute  into  the  remaining  equations. 

3.  Repeat 


Example  1.13 

tion; 

Solution; 


Find  the  general  solution  for  the  following  linear  equation  using  substitu- 
cc  +  2y  =  5. 


Solve  for  x  in  terms  of  y. 

X  =  5  -2y. 

For  every  value  of  y  there  is  a  different  value  for  x.  Let  y  be  any  real  number.  The  general 
solution  for  the  linear  equation  is  a:  =  5  -  2s  ,  r/  =  s.  There  are  infinitely  many  solutions 
as  y  varies  through  the  real  numbers. 

Example  1.14  Use  substitution  to  solve  the  linear  system; 

2x  2>y  —  z  =  b 

4a:  +  8y  —  62:  =  2 

3a:  +  6y  —  62:  =  0. 


Solution: 

Solve  for  2;  in  terms  of  x  and  y  in  the  first  equation: 


2:  =  2a:  +  3^  —  5. 

Substitute  for  2:  in  the  second  and  third  equations: 


2a:  +  3y  —  2:  =  5 
4a:  +  8y  —  6  (2a;  +  3y  —  5)  =  2 
3a:  4-  6y  —  5  (2a;  +  3y  —  5)  =  0. 


This  simplifies  to; 

2a;  +  3y  —  2:  =  5 

—8a:  —  lOy  =  —28 
-7x-9y  =  -25. 

Solve  for  y  in  the  second  equation.; 


14  4 

y  = - X. 

^55 
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Substitute  for  y  in  the  third  equation: 


2x  -{-“iy  —  z  =  5 

-Sx  -  lOy  =  -28 

This  simplifies  to: 

2a:  +  3y  —  z  =  5 

-8a;  -  lOy  =  -28 
1  1 

5- 

Solving  for  x  in  the  third  equation  we  get  a;  =  1 .  Substituting  a;  =  1  into  the  second  equation 
and  solving  for  y  we  get  y  =  2.  Substituting  a;  =  1,  y  =  .2  into  the  first  equation  we  get 
z  =  3.  There  is  a  unique  solution  for  this  system  of  linear  equations:  {x,  y,  z)  =  (1, 2, 3). 
This  solution  simultaneously  satisfies  each  equation  in  the  linear  system. 

In  the  process  of  solving  this  system  of  linear  equations  we  appear  to  have  changed 
the  linear  equations  in  the  system.  The  new  equations  are  a  result  of  making  valid  substi¬ 
tutions  for  variables  into  the  old  equations.  Therefore,  the  systems  of  linear  equations  are 
actually  equivalent,  yet  the  new  system  is  easier  to  solve.  In  solving  systems  of  linear  equa¬ 
tions  we  want  to  try  to  replace  the  existing  system  with  an  equivalent  system  which  has 
the  same  solution  set,  but  is  easier  to  solve.  We  say  two  linear  systems  are  equivalent  if 
they  have  the  same  solution  set.  There  are  three  operations  which  maintain  equivalence  for 
linear  systems. 

1 .  Scaling:  Multiply  an  equation  in  the  system  by  a  nonzero  real  number  (scalar). 

2.  Equation  interchange:  Interchange  two  equations  in  the  system. 

3.  Equation  replacement:  Add  a  multiple  of  one  equation  to  another  equation 
in  the  system. 

Applyfng  one,  or  any  combination,  of  these  operations  to  a  system  of  linear  equations  will 
result  in  a  new  system  of  linear  equations  which  is  equivalent  to  the  original  system. 

A  matrix  is  a  rectangular  array  of  numbers.  We  will  study  the  arithmetic  of  matrices 
in  Chapter  II.  The  matrix  of  coefficients  is  a  matrix  consisting  of  the  coefficients  of  the 
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variables  of  the  linear  equations.  The  auffnented  matrix  for  a  system  of  linear  equations 
is  a  shorthand  notation  with  which  we  can  represent  the  linear  system.  The  augmented 
matrix  consists  of  the  matrix  of  coefficients  and  the  right  hand  side  constants  of  the  linear 
equations.  Given  the  system  of  linear  equations: 

auXi  +  ai2X2  H - h  ai„Xn  =  bi 

0.21X1  +  O22X2  +  •  •  •  +  02nXn  =  62 


OmlXi  +  am2^2  +  •  '  •  +  OmnXn  =  &m) 


the  matrix  of  coefficients  is: 


Oil  O12 

O21  O22 


L  ^ml  ^m2 


and  the  augmented  matrix  is: 


Oln 

02n 


^mn  J 


Oil 

O12 

• 

^In 

bi  ] 

<^21 

O22 

02n 

&2 

.  Ofni 

Ojn2 

Omn 

bm  - 

Using  the  augmented  matrix  to  represent  a  system  of  linear  equations,  we  must  keep  track 
of  the  variables  Xi,  the  +’s  and  the  =’s. 

'  ^  A  matrix  with  m  rows  and  n  columns  is  an  m  x  n  matrix;  m  and  n  are  the  dimensions 
of  the  matrix. 
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Example  1.15  Write  the  augmented  matrix  for  the  linear  system: 

2x  +  Zy  —  z  —  h 

4a;  +  8y  —  62;  =  2 

3a;  +  6y  —  Sz  =  0. 

Solution: 

The  augmented  matrix  for  the  above  system  of  linear  equations  is; 

■  2  3  -1  5 ■ 

48-62  . 

3  6-50 

This  is  a  matrix  of  dimension  3x4,  because  the  matrix  has  3  rows  and  4  columns. 

Just  as  we  can  create  an  equivalent  system  of  linear  equations  using  scaling,  equation 
interchange,  and  equation  replacement,  we  can  produce  an  equivalent  augmented  matrix 
using  elementary  row  operations.  Elementary  row  operations  are: 

1 .  Scaling:  Multiply  all  entries  in  a  row  of  the  augmented  matrix  by  a  nonzero 
constant  (scalar). 

2.  Row  interchange:  Interchange  two  rows  in  the  augmented  matrix. 

3.  Row  replacement:  Add  a  multiple  of  one  row  to  another  row  in  the  aug¬ 
mented  matrix. 

Elementary  row  operations  can  be  performed  on  any  matrix,  not  just  the  augmented 
matrix.  However,  we  will  use  the  augmented  matrix  and  the  elementary  row  operations  to 
solve  systems  of  linear  equations. 

2.  Gaussian  Elimination  with  Back  Substitution 

Gaussian  elimination  is  a  process  which  takes  a  system  of  linear  equations  and  turns 
it  into  a  triangular  system  of  linear  equations  using  elementary  row  operations.  The  solution 
is  then^easy  to  find  using  back  substitution.  So,  the  objective  is  to  replace  the  system  with 
an  equivalent  system  which  is  easier  to  solve.  Let’s  start  with  an  example. 

Example  1.16  Find  the  solution  set  for  the  following  system  of  linear  equations.  We  will 
work  with  the  linear  system  on  the  left  and  the  augmented  matrix  of  the  linear  system  on 
the  right: 
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Sy  stem  of  Linear  Equations  Augmented  Matrix 


6a;i 

+ 

4X2 

-  23  = 

-4 

■  6 

4 

-2 

-4 

3xi 

+ 

^2 

II 

00 

H 

1 

-5 

3 

1 

-2 

-5 

9xi 

+ 

6rE2 

+  3xs  = 

6, 

9 

6 

3 

6 

Solution: 

Add  ^  times  the  first  row  to  the  second  row. 

Add  ^  times  the  first  row  to  the  third  row: 

6a;i  +  4x2  —  2x3  =  —4 

-  X2  -  X3  ^  -3 

6x3  =  12, 

Solve  for  X3  in  the  third  row: 

6x3  =  12 

X3  =  2. 

Using  back  substitution,  solve  for  X2  in  the  second  equation: 

-X2  -X3  =  -3 

-X2  -  2  =  -3 
^2  =  1- 

Using  back  substitution,  solve  for  xi  in  the  first  equation:  • 

6x1  +  4X2  —  2X3  = 

6a:i+4(l)-2(2)  = 

6x1  = 

Xi  = 

The  solution  is  (xi,X2,  X3)  —  1, 2)  .  The  solution  is  unique. 

We  stated  that  Gaussian  elimination  takes  a  system  of  linear  equations  and  turns  it 
into  an  equivalent  triangular  system  of  linear  equations  using  elementary  row  operations. 
The  solution  is  then  easy  to  find  using  back  substitution.  Two  questions  arise: 

1.  What  should  a  triangular  system  of  linear  equations  look  like? 

2.  How  do  I  make  the  linear  system  triangular? 

In  order  to  answer  these  questions,  we  must  first  learn  about  two  special  forms  for 


-4 

-4 

-4 

T‘ 


6  4-2-4 

0  -1  -1  -3 
0  0  6  12 
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any  matrix.  These  form  are;  row  echelon  form  and  reduced  row  echelon  form. 


a.  Row  Echelon  Form/Reduced  Row  Echelon  Form 


A  matrix  is  in  row  echelon  form  if  the  following  three  properties  apply; 


1.  Rows  which  have  zeros  in  all  entries,  are  at  the  bottom  of  the  matrix. 

2.  In  rows  which  have  nonzero  entries,  the  leading  nonzero  entry  (pivot)  in  the 
upper  row  is  to  the  left  of  the  leading  nonzero  entry  (pivot)  in  the  lower  row. 

3.  All  entries  in  a  column  below  the  pivot  are  zeros. 

(Note.  Some  books  will  state  that  the  pivot  should  be  a  Ij  however,  we  will  not 
make  that  additional  requirement  for  row  echelon  form.) 

A  matrix  is  in  reduced  row  echelon  form  if  the  matrix  is  in  row  echelon  form  and.- 


1.  In  rows  which  have  nonzero  entries,  the  leading  nonzero  entry  (pivot)  in  the 
row  is  1. 

2.  Each  column  containing  a  pivot  has  zeros  in  every  position  above  and  below 
the  pivot. 


Row  Echelon  Form 

Row  Echelon  Form 

'  2  3  4  -7  ' 

'  1  -6  5  2  -5  4  ' 

Example  1.17 

0  5-1  3 

0  0  -2  8  -1  5 

0  0  3  2 

0  0  0  0  3  4 

Example  1.18 


Reduced  Row  Echelon  Form 

1-3001 
0  0  10  9 

0  0  0  1  6 

0  0  0  0  0 


Reduced  Row  Echelon  Form 

1  7  0  9  0  0 

0  0  1  -6  0  3 

0  0  0  0  1  -7 


Any  matrix  can  be  changed  into  row  echelon  form  or  reduced  row  echelon  form  by 
applying  elementary  row  operations  to  the  matrix  using  the  following  algorithm. 


1.  Start  with  the  first  nonzero  column  from  the  left;  this  is  ihQ pivot  column. 

2.  The  top  position  in  the  pivot  column  is  the  pivot  position.  Interchange  the  top 
row  with  another  row,  if  necessary,  to  move  a  nonzero  entry  into  the  pivot  position. 
This  nonzero  entry  is  ihe pivot.  The  row  containing  the  pivot  is  the  pivot  row.  The 
pivot  is  underlined  in  the  examples  above. 
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3.  Use  elementary  row  operations  to  get  zeros  in  all  the  positions  in  the  column 
below  the  pivot  position. 

4.  Cover  the  row  containing  the  pivot  position.  Start  with  step  1  and  repeat  the 
process  on  the  remaining  rows  below.  Continue  this  process  until  the  entire  matrix 
is  in  row  echelon  form. 

To  change  the  matrix  to  reduced  row  echelon  form,  put  the  matrix  in  row  echelon 
form  using  the  steps  above  and  add  one  more  step. 

5.  Start  with  the  first  pivot  from  the  right.  If  a  pivot  is  not  1,  make  it  1  by 
dividing  each  entry  in  the  pivot  row  by  the  pivot.  Use  row  replacement  to  get  zeros 
above  each  pivot. 


Row  echelon  form  of  a  matrix  is  not  unique.  Changing  the  sequence  in  which  the 
elementary  row  operations  are  performed  will  produce  different  coefficients.  However,  the 
systems  are  still  equivalent.  On  the  other  hand,  reduced  row  echelon  form  is  unique. 

The  terms  leading  nonzero  entry,  pivot,  and  pivot  position  have  been  mentioned  in 
developing  the  row  echelon  and  reduced  row  echelon  forms  of  a  matrix.  This  brings  up  the 
concept  of  a  pivot  variable.  What  exactly  is  the  pivot  variable?  Well,  just  as  you  would 
suspect,  the  pivot  variable  is  the  variable  in  the  system  of  linear  equations  corresponding  to 
the  pivot  position  in  a  row  of  a  matrix.  The  pivot  is  underlined  in  the  following  examples. 

When  we  solve  a  system  of  linear  equations  we  usually  try  to  solve  for  the  pivot 
variable  in  terms  of  the  variables  to  the  right  in  each  linear  equation.  Since  we  solve  for  the 
pivot  variables  in  terms  of  the  other  variables,  we  say  the  pivot  variables  are  the  dependent 
variables.  The  value  of  the  pivot  variables  depend  on  the  value  of  the  other  variables.  You 
will  also  hear  the  term  basic  variable  used  to  refer  to  the  pivot  variable. 

If  a  variable  is  not  a  pivot  variable,  it  is  called  a  free  variable,  or  an  independent 
variable.  We  assign  parameters  to  the  independent  variables  to  get  the  general  solution. 
Each  different  choice  of  value  for  the  independent  variable  determines  a  different  solution 
for  the  linear  system.  A  solution  set  can  have  more  than  one  independent  variable 
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Example  1.19  Consider  the  4  x  5  augmented  matrix; 

Augmented  Matrix  of  linear  system  with  4  equations  and  4  variables 

"l  2-1  3  6' 

0  -2  1  0 

0  0  ^  -2  -3  • 

0  0  0  ^2 

There  are  four  pivot  positions  which  correspond  to  the  four  pivot  variables,a;i,  0:2,  x^,  and 

0:4,  in  this  augmented  matrix.  The  corresponding  linear  system  has  a  unique  solution  (^,  —2). 


Example  1.20  Consider  the  3  x  6  augmented  matrix: 

Augmented  Matrix  of  linear  system  with  3  equations  and  5  variables. 

■  1  -1  -1  0  0  1  ■ 

0  0  0  1  0  3. 

0  0  0  0  1  1 

There  are  three  pivot  positions  which  correspond  to  the  three  pivot  variables  in  the  system 
of  linear  equations.  The  other  two  variables  are  independent  variables.  The  system  has  the 
general  solution: 

Xi  =  I+X2+XS 

X2  =  X2 

xz  =  Xz 

x^  3 

Xz  =  1. 

In  this  solution  set,  rr  1,^4, and  Xz  are  the  pivot/dependent  variables;  X2  and  X3  are  the 
free/independent  variables 

The  method  of  solving  systems  of  linear  equations  by  reducing  the  augmented  ma¬ 
trix  to  row  echelon  form  is  called  Gaussian  Elimination.  ■ 

Let’s  do  another  example.  This  time  we  will  perform  elementary  row  operations  on 
the  augmented  matrix  only. 


Example  1.21  Given  the  system  of  linear  equations: 


Xi 

+ 

SX2  - 

-  2xz 

+ 

2xz 

+ 

6xz 

=  2 

2xi 

+ 

6X2  - 

-  ^Xz 

+ 

4xz 

=  0 

2xi 

+ 

6X2  - 

-  Sxz  - 

(M 

1 

+ 

4xz 

+ 

9xe 

=  3 

4xi 

12X2  - 

-  92:3  - 

-  2X4 

+ 

8x5 

+ 

21xe 

=  7 
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write  the  augmented  matrix: 


1 

3 

-2 

0 

2 

6 

2. 

2 

6 

-4 

0 

4 

0 

0 

2 

6 

-5 

-2 

4 

9 

3 

4 

12 

-9 

-2 

8 

21 

7 

Solution: 


Add  —2  times  the  first  row  to  the  second  and  third  rows, 
add  -4  times  the  first  row  to  the  fourth  row: 


1 

3 

-2 

0 

2 

6 

2 

0 

0 

0 

0 

0 

-12 

-4 

0 

0 

-1  ■ 

-2 

0 

-3 

-1 

0 

0 

-1  - 

-2 

0 

-3 

-1 

Interchange  the  second  and 

third 

i  rows: 

■  1 

3 

-2 

0 

2 

6 

2 

0 

0 

-1  - 

-2 

0 

-3 

-1 

0 

0 

0 

0 

0 

-12 

-4 

0 

0 

-1  - 

-2 

0 

-3 

-1 

Add  -1  times  the  second  row  to  the 

fourth 

row 

■  1 

3 

-2 

0 

2 

6 

2 

0 

0 

-1 

-2 

0 

-3 

-1 

0 

0 

0 

0 

0 

-12 

-4 

0 

0 

0 

0 

0 

0 

0 

This  is  row  echelon  form.  The  pivots  are  underlined. 

Write  the  corresponding  system  of  linear  equations  using  the  new  coefficients: 

X\  +  3x2  —  2xs  +  2x^  +  6xq  =  2 

-  X3  -  2X4  -  3xe  =  -1 

-  12x6  =  -4. 

Solve  the  equations  for  the  pivot  variables.  The  pivot  variables  are  the  variables  corre¬ 
sponding  to  the  pivots  of  each  linear  equation: 


X}  —  3x2  -|-  2x3  —  23:5  —  6x6  ”b  2 

^3  ~  23:4  —  Saig  -|- 1 

1 
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Begin  at  the  bottom  and  back  substitute  into  the  equations  above: 


^3  =  —2X4  —  3X6  +  1 


X3  =  —2X4. 

Substitute  X3  into  the  first  equation: 


Xi 

Xi 

Xi 


3x2  “h  2x3  —  2x5  —  6x0  “1“  2 
—3x2  +  2  (—2x4)  —  2x5  —  6 
—3x2  —  4x4  —  2x5 


+  2 


Assign  arbitrary  values  to  the  independent  variables  to  get  the  general  solution: 

"  xi  =  — 3r  —  As  —  2t 
X2  =  r 

X3  =  -2s 

X4  =  s 

X5  =  t 

[  xe  =  I 

The  general  solution  is  represented  by  parametric  equations.  Each  solution  to  the  linear 
system  is  uniquely  determined  by  the  parameters  r,  s,  and  t,  which  are  real  numbers.  The 
pivot  variables  are  xi  X3,  and  xe.  The  free  variables  are  X2  X4,  and  X5. 


Remember,  our  objective  is  to  replace  the  current  system  of  linear  equations  with  an 
equivalent  system  which  is  easier  to  solve.  This  method  of  solving  systems  of  linear  equa¬ 
tions  by  reducing  the  augmented  matrix  to  row  echelon  form  then  using  back  substitution 
to  find  the  solution  set  is  called  Gaussian  elimination  with  back  substitution. 

Notice  we  interchanged  rows  in  one  step  of  the  reduction  process.  This  interchange 
was  necessary  to  obtain  a  nonzero  entry  in  the  pivot  position.  In  general,  interchanging 
rows  may  be  a  necessary  operation  to  obtain  a  nonzero  entry  in  the  pivot  position. 

Another  method  for  solving  systems  of  linear  equations  is  Gauss-Jordan  elimination. 


3.  Gauss-Jordan  Elimination 

Gauss-Jordan  elimination  involves  changing  the  augmented  matrix  of  a  linear  sys¬ 
tem  to  reduced  row  echelon  form.  Since  reduced  row  echelon  form  is  a  step  beyond  row 
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echelon  form,  let’s  continue  with  the  same  example. 

Example  1.22  We  began  Example  1.21  with  the  following  system  of  equations: 


Xi 

-f- 

3X2 

-  2x3 

-1- 

2X5 

-t- 

6X6 

=  2 

2xi 

+ 

6x2 

-  4X3 

+ 

4X5 

=  0 

2xi 

+ 

6x2 

-  5X3  - 

2x4 

-1- 

4X5 

+ 

9X6 

=  3 

4xi 

-h 

12X2 

-  9X3  - 

2X4 

4- 

8x5 

-1- 

21X6 

=  7 

In  Example  1.21,  we  changed  the  augmented  matrix  into  row  echelon  form; 

’13-2  02  6  2 ■ 

0  0  ::4  -2  0  -3  -1 

0  0  0  0  0  ^  -4 

0  0  0  0  0  0  0 

We  now  continue  with  our  algorithm  to  change  the  augmented  matrix  to  reduced  row  ech¬ 
elon  form. 

Multiply  the  second  row  by  -1,  and 
multiply  the  third  row  by 

■  1  3  -2  0  2  0  0  '• 

0  0  1  2  0  3  1 

0  0  0  0  0  1  I  • 

0  0  0  0  0  0  0 

Add  —3  times  the  third  row  to  the  second  row: 

■13-20200" 

0  0  1  2  0  0  0 

0  0  0  0  0  1  I  • 

0  0  0  0  0  0  0 

Add  2  times  the  second  row  to  the  first  row  to  produce  the  reduced  row  echelon  form; 

'  1  3  0  4  2  0  0  ' 

0  0  1  2  0  0  0 

0  0  0  0  0  1  I 

0  0  0  0  0  0  0 

Rewrife  the  system  of  linear  equations: 

^1  “f  3^2  -|-  4x4  “h  2x5 

X3  2X4 

Xe 


=  0 
=  0 
1 

3' 
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Solve  for  the  pivot  variables; 


—  3^2  4^/4 

Xz  —  —2X4^ 

xe  = 

Assign  arbitrary  values  to  the  independent  variables  to  get  the  general  solution: 

'  xi  =  -3r  -  4s  -  2t 
X2  =  r 

^  Xz  =  -2s 

X4  =  s 

X5  =  t 

(  Xe  =  I 

Notice  that  the  solution  set  is  represented  by  parametric  equations  where  the  parameters  r, 
s,  and  t  are  real  numbers. 


We  have  just  solved  the  system  of  linear  equations  using  Gauss-Jordan  elimination. 
This  method  tends  to  involve  more  arithmetic  than  Gaussian  elimination.  Most  computer 
algorithms  perform  Gaussian  elimination  to  solve  systems  of  linear  equations. 

D.  EXISTENCE  AND  UNIQUENESS  OF  A  SOLUTION 

Now  that  we  can  solve  systems  of  linear  equations,  let’s  consider  how  to  determine 
whether  a  solution  exists  and,  if  a  solution  does  exit,  whether  that  solution  is  unique. 

When  the  augmented  matrix  for  a  system  of  linear  equations  is  in  row  echelon  form 
or  reduced  row  echelon  form,  there  will  sometimes  be  row  of  the  form: 


[0  0...0  b] . 

If  6  0  in  any  of  the  rows  with  this  form,  when  we  write  the  linear  equation  corresponding 

to  this  row  we  get: 

Oxi  -f  0x2  +  •  •  •  +  OXfi  =  b,  6^0 

0  =  6,  b^O. 

There  are  no  variables  Xi,  X2,...,  Xn  which  will  make  this  linear  equation  true;  therefore,  the 
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linear  system  is  inconsistent. 

If  6  =  0  in  all  of  the  rows  with  this  form,  the  rows  will  result  in  linear  equations: 

0  =  0, 

which  is  true  for  any  variable  therefore,  the  system  is  consistent. 

This  idea  is  summarized  in  the  following  theorem  [Ref  1]; 

Theorem  1.1  A  system  of  linear  equations  is  inconsistent  if  and  only  if  in  the  (reduced) 
row  echelon  form,  there  is  a  row  of  the  form: 

[0, 0...0  b] ,  where  bfO. 

A  system  of  linear  equations  is  consistent  if  it  is  not  inconsistent  A  consistent  linear  system 
will  have: 

1.  A  unique  solution  when  every  variable  is  a  pivot  variable. 

2.  Infinitely  many  solutions  when  at  least  one  variable  is  an  independent  vari¬ 
able. 

This  theorem  applies  to  nonhomogeneous  systems  of  linear  equations,  which  are 
sometimes  consistent  and  sometimes  inconsistent.  The  linear  systems  with  which  we  have 
been  working  have  been  nonhomogeneous  systems  of  linear  equations.  In  the  next  section 
we  will  learn  about  a  new  type  of  linear  system  which  is  always  consistent,  the  homogeneous 
system  of  linear  equations.  Before  we  study  homogeneous  linear  systems,  weTl  look  at  the 
application  of  linear  systems  in  solving  network  problems. 

When  we  want  to  move  some  product  from  one  location  to  another  location,  we  de¬ 
sign  routes  along  which  these  products  can  move.  We  call  these  routes  networks.  Electricity 
moves  from  power  plants  to  our  houses  along  power  line  networks.  We  communicate  long 
distances  using  telephone  networks.  We  travel  to  different  places  using  traffic  networks 
such  4s  highways,  railroads,  airline  routes,  and  sea  routes.  We  want  products  to  move  along 
networks  efficiently,  so  we  plan  the  movement  by  modelling  the  network  as  a  mathematical 
object.  Network  models  consist  of  points  called  nodes  which  are  connected  by  lines  called 
arcs.  Product  movement  through  a  network  is  called  flow.  For  example,  in  a  traffic  network 
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the  roads  are  the  arcs  and  the  points  of  intersection  of  the  roads  are  the  nodes.  Cars  flow  be¬ 
tween  nodes  along  arcs  in  directions  indicated  by  arrows.  A  set  of  one-way  streets  would 


Figure  4.  One-way  street  network.  After  Ref  [1]. 

be  modeled  as  shown  in  figure  4.  The  basic  idea  behind  solving  a  network  problem  is  bal¬ 
ance  of  flow.  Balance  of  flow  means  what  flows  into  a  node  must  equal  what  flows  out  of 
a  node.  In  figure  4  we  see  that  30  cars  flow  into  node  A  and  30  cars  flow  out  of  node  A. 

Another  network  problem  could  deal  with  communication  lines.  Suppose  that  a 
signal  company  is  establishing  communication  lines  in  a  tactical  area  of  responsibility.  The 
company  has  received  only  partial  information  on  the  number  of  lines  needed.  The  in¬ 
formation  received  and  the  lines  planned  are  shown  in  the  network  model  in  figure  5. 
Determine  the  number  of  lines  which  the  signal  company  must  establish  along  the  arcs 
xi,X2,xs,X4^,x^,  and  xq.  Remember,  in  a  network  problem,  balance  of  flow  is  the  goal. 
The  number  of  lines  into  a  node  must  equal  the  number  of  lines  out  of  the  node.  The  equa¬ 
tions  for  this  communication  network  are; 

20  -(-  a;2  =  15  +  a^i  (node  A) 

20  -I-  a;4  =  20-1-  xz  (node  B) 

20  +  xi  =  25  -t-  Xi  (node  C) 

15  +  Xz  =  20-1-  X2  (node  D) 


25 


Figure  5.  Comrnunications  Network 
25  +  xq  =  20  -f-  X5  (node  E). 


We  can  rewrite  these  equations  as; 


Xi  —  X2  =  5 

X3  -  x^  =  0 

Xi  —  X4  =  0 

X2  -  X5  =  -5 

X3  Xq  —  5. 


The  augmented  matrix  is; 


1-10  0  0  0  5  ‘ 
0  0  1  -1  0  0  0 

1  0  0  -1  0  0  5 

0  10  0-1  0-5 

0  0  0  0  1  -1  5. 


Interchange  row  2  and  row  4; 


1  -1  0  0  0  0  5 

0  10  0-1  0-5 
1  0  0  -1  0  0  '5 

0  0  1  -1  0  0  0 

0  0  0  0  1  -1  5. 
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Interchange  row  3  and  row  4: 


1  -1  0  0  0  0  5 

0  10  0-1  0-5 

0  0  1  -1  0  0  0 

1  0  0  -1  0  0  5 

_  0  0  0  0  1  -1  5. 

Add  -1  times  row  1  to  row  4: 

’  1  -1  0  0  0  0  5 

0  10  0-1  0-5 

0  0  1  -1  0  0  0 

0  10-1000 
0  0  0  0  1  -1  5. 

Add  -1  times  row  2  to  row  4: 

’  1  -1  0  0  0  0  5 

0  10  0-1  0-5 

0  0  1  -1  0  0  0 

0  0  0  -1  1  0  5 

_  0  0  0  0  1  -1  5. 

Multiply  row  4  by  - 1 : 

'  1  -1  0  0  0  0  5 

0  10  0-1  0-5 

0  0  1  -1  0  0  .0 

0  0  0  1  -1  0  -5 

0  0  0  0  1  -1  5. 


When  we  solve  for  the  pivot  variables  we  get: 


—  ajg  +  5 

X-i  ^  Xq 

xz  =  xe 

X4  =  Xe 

Xe  =  Xg  +  5 

Xe  =  Xe. 

The  signal  company  needs  to  assign  a  fixed  number  of  lines  which  will  enter  the  network 
on  arc  after  which,  the  remainder  of  the  lines  needed  are  determined  by  the  equations 
above. 
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E.  HOMOGENEOUS  SYSTEMS  OF  LINEAR  EQUATIONS 

A  homogeneous  system  of  linear  equations  is  a  system  in  which  all  the  constant 
terms  on  the  right  hand  side  of  the  equations  are  zero: 


ClllXi  +  0,12X2  +  •  •  •  +  OinXn  —  0 

®21^1  +  <122X2  +  •  •  •  +  0,2nXn  —  0 


<lTnlXi  “1"  <lm2X2  <lmnXn  0* 

Unlike  nonhomogeneous  systems  of  linear  equations,  homogeneous  systems  of  linear  equa¬ 
tions  are  always  consistent.  Homogeneous  systems  have  two  possible  solution  sets; 


1.  One  solution  -  the  trivial  solution  in  which  each  variable  is  equal  to  zero: 

xi  =  0,a;2  =  0,  ...,Xn  =  0. 

2.  Infinitely  many  solutions  -  nontrivial  solutions  as  well  as  the  trivial  solution. 


Let’s  solve  a  homogeneous  system  of  linear  equations. 

Example  1.23  Given  the  following  augmented  matrix  and  equivalent  reduced  row  echelon 
form  of  the  matrix: 


Augmented  Matrix  Reduced  Row  Echelon  Form 


2 

4 

-1 

0 

2 

0  ■ 

■  1 

0 

0 

0 

-2 

0  ■ 

-2 

-3 

2 

-1 

0 

0 

row  equivalent  to 

0 

1 

0 

0 

3 

2 

0 

1 

1 

2 

1 

-1 

0 

0 

0 

1 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

1 

-1 

2 

0 

Solution: 


Write  die  corresponding  system  of  linear  equations: 


Xi 


—  2x5  =  0 

X2  +  |ai5  =  0 

Xs  =0 

X4  —  |X5  =  0. 
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Solve  for  the  pivot/dependent  variables: 


xi  —  2x^ 

xz  =  0 

x^  =  |rc5. 

The  general  nontrivial  solution  is; 

'  x\  =  2s 

x%  =  —Z/2s 

<  xz  ==  0 

X4,  =  l/2s 

^  iCs  =  s. 

The  trivial  solution  occurs  when  s  =  0. 

An  important  observation  in  solving  homogeneous  systems  of  linear  equations  is 
that  performing  elementaiy  row  operations  will  not  change  the  zeros  in  the  column  of  right 
hand  side  constants  of  the  augmented  matrix.. 

We  have  the  theorem  of  existence  and  uniqueness  for  solutions  to  nonhomogeneous 
linear  systems.  Similarly,  we  have  a  theorem  which  addresses  the  existence  of  nontrivial 
solutions  to  homogeneous  linear  systems. 

Theorem  1,2  An  underdetermined  homogeneous  system  of  linear  equations  has  at  least 
one  independent  variable  and;  therefore,  has  nontrivial  solutions. 


Be  careful!  The  theorem  says  nothing  about  a  linear  system  in  which  the  number  of 
variables  is  equal  to  the  number  of  equations.  Below  are  two  distinct  examples  in  which  the 
homogeneous  linear  system  has  the  same  number  of  variables  as  equations  yet  for  the  first 
example  there  are  infinitely  many  nontrivial  solutions  and  for  the  second  example  there  is 
only  one  solution,  the  trivial  solution. 

Example  1.24  Determine  if  the  following  homogeneous  system  of  linear  equations  has  a 
nontrivial  solution: 

6x1  +  lOxz  +  3xz  =  0 

-6x1  -  4a;2  -  Srcs  =  0 

12xi  +  2^2  +  60^3  =  0. 

Solution: 
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Write  the  augmented  matrix; 


6 

10 

3 

0  ■ 

'  6 

10 

3 

0  ■ 

■  6 

10 

3 

0  ■ 

-6 

-4 

-3 

0 

0 

6 

0 

0 

0 

6 

0 

0 

12 

2 

6 

0 

0 

-18 

0 

0 

0 

0 

0 

0 

Add  I  times  row  1  to  row  2  Add  3  times  row  2  to  row  3  This  is  row  echelon  form 

Add  -2  times  row  1  to  row  3 


Here  we  can  see  that  is  free;  therefore,  there  are  nontrivial  solutions.  Continue  to  reduced 
row  echelon  form: 


■  6 

10 

3 

0  ■ 

■  1 

5 

3 

1 

2 

0  ■ 

■  1 

0 

1 

2 

0  ■ 

0 

6 

0 

0 

0 

1 

0 

0 

rsj 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

This  is  row  echelon  form  2  to  row  1  This  is  reduced  row  echelon  form 

Multiply  row  1  by  ^ 

Multiply  row  2  by  ^ 


Write  the  corresponding  system  of  linear  equations: 

+  ^Xs  =  0 

X2  =0 

0=0. 

Solve  for  the  pivot  variables: 

X2  =  0 

Xi  =  Xz. 

The  general  solution  is: 

{Xi  = 

X2  =  0 

^3  =  S. 

The  trivial  solution  occurs  when  s  =  0. 


Example  1.25  Solve  the  following  homogeneous  system  of  linear  equations: 

2xi  +  2x2  =  0 

4xi  +  2x2  +  4x3  =  0 
4xi  -|-  6x3  =  0. 


Solution: 
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Write  the  augmented  matrix; 


2  2  0  0 
4  2  4  0 
4  0  6  0 


2  2  0  0 
0-240 
0-460 


Add  -2  times  row  1  to  row  2  Add  -2  times  row  2  to  row  3 
Add  -2  times  row  1  to  row  3 


2  2  0  0 
0-2  4  0 

0  0-2  0 

Row  echelon  form 


Write  the  corresponding  system  of  linear  equations: 


2xi  -f  2x2 

- 

=  0 

—  2X2  "b 

4X3  = 

=  0 

— 

2X3  = 

=  0. 

Solve  for  the  pivot  variables: 

Xi  = 

-X2 

X2  = 

2X3 

Xz  = 

0. 

The  only  solution  is  the  trivial  solution 

r  xi  = 

0 

\  X2  = 

0 

1  Xz  = 

0. 

E  COMPUTERS  AND  SY STEMS  OF  LINEAR  EQUATIONS 

Geometrically  speaking,  the  solution  to  a  linear  system  can  be  interpreted  as  the 
points  of  intersection  of  the  linear  equations.  The  problems  we  will  study  can  be  solved  by 
hand  and  sometimes  even  graphed.  In  the  real  world,  problems  are  much  more  extensive 
and  require  the  use  of  calculators  and  computer  software.  In  using  automation,  we  must  be 
aware  of  the  probability  of  error.  The  errors  we  are  talking  about  are  not  human  error,  but 
rather  machine  limitations  and  design. 


Types  of  error; 

•  Machine  epsilon  -  Machine  epsilon  is  the  smallest  number  e  such  that  1  +  £  >  1  on 

the  machine,  e  is  a  measure  of  the  relative  error  committed  in  storing  numbers  on  the 
computer. 

•  Truncation  Error-  This  error  occurs  when  we  approximate  a  number  even  though  the 
number  requires  an  infinitely  long  sequence  of  numbers. 

•  Round-OffError  -  Digital  computers  generally  use  floating-point  numbers  of  fixed  word 
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length.  The  tme  value  of  a  number  is  not  expressed  exactly  due  to  the  computer  imper¬ 
fection  of  round-off  error. 

Why  are  we  concerned  with  error?  Consider  two  lines  which  are  nearly  parallel. 
The  two  equations  are  not  proportional,  but  are  nearly  proportional.  A  small  error  in  the 
coefficient  of  a  variable  will  result  in  turning,  raising,  or  lowering  a  nearly  parallel  line 
slightly,  thereby  causing  a  large  change  in  the  point  of  intersection,  relatively  speaking. 
So,  in  the  two  equations,  a  small  error  in  the  coefficients  can  result  in  a  large  error  in  the 
solution.  A  system  is  said  to  be  ill-conditioned  when  a  small  change  in  a  coefficient  or 
the  right  hand  side  constant  results  in  a  large  change  in  the  solution.  The  following  is  an 
example  of  an  ill-conditioned  system.  [Ref.  2] 

Example  1.26  Consider  two  nearly  parallel  lines, 

1.4142a;  —  y  =  0 
y/2x  —  y  =  0. 

This  system  has  a  unique  solution  (a:,  y)  =  (0, 0).  If  we  introduce  a  small  change  in  the 
right  hand  side  of  the  second  equation  we  shift  the  line  corresponding  to  the  second  equati  on 
slightly. 


1.4142a:  — y  =  0 
V2x  —  y  =  0.001. 

In  this  case,  the  y-intercept  will  change,  but  the  slope  remains  the  same.  This  system  has  the 
unique  solution  (x,  y)  =  (73.7, 104.3).  So,  the  system  of  linear  equations  is  ill-conditioned 
because  a  small  change  in  a  coefficient  produced  a  large  change  in  the  solution. 

Example  1.27  Machine  computation  also  results  in  unexpected  errors.  Consider  the  sys¬ 
tem. 


O.OOOlx  +  y  =  1 
x-{-y  =  2. 

This  system  has  the  approximate  solution  (x,  y)  =  (1.0001, 0.9999).  Using  Gaussian  elim¬ 
ination  and  rounding  to  three  significant  digits,  we  will  get  the  solution  (x,y)  =  (0, 1). 
However,  if  we  interchange  the  equations  before  eliminating  variables,  and  still  round  to 
three  significant  digits,  we  will  get  the  solution  (x,y)  =  (1, 1).  This  row  interchange  is  an 
example  of  partial  pivoting.  Partial  pivoting  is  a  strategy  for  interchanging  rows  to  obtain 
nonzero  entries  in  the  pivot  position,  which  will  reduce  round-off  error.  The  idea  behind 
partial  pivoting  is  that  when  a  number  has  some  error  in  it  resulting  from  round-off,  divid¬ 
ing  that  number  by  a  value  near  zero  will  increase  the  error.  For  this  reason,  we  want  the 
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pivot  entry  to  be  as  far  from  zero  as  possible.  In  order  to  ensure  we  minimize  error,  we 
interchange  rows  as  necessary  to  place  the  largest  entry,  in  absolute  value,  in  the  pivot  po¬ 
sition.  Partial  pivoting  is  may  be  done  for  other  reasons  even  when  it  is  not  necessary  to 
obtain  the  largest  pivot  entry.  This  strategy  and  others  are  described  in  numerical  analysis 
textbooks. 


G.  EXERCISES 


1.  Decide  whether  the  following  equations  are  linear  or  nonlinear  in  the  vari¬ 
ables  a;,  y,  2:. 

a)  2xi  -h  3xiXs  +  X2  =  2 

b)  —Xi  -f  2x2  +  ^3  =  tan(k)  (k  is  a  constant) 

c)  3xi  —  X2  +  2x3  =  6 


d)  Xi  -t-  \/5x2  =  X3  —  4 

e)  —xi  -  X2^  +  3  =  a;3 

f) X2  =X3 

g)  2x  4-  4yz  =  6 

h)  X  —  6y  +  z  —  sint  =  (s,t  are  constants) 

i)  a;  -1-  16y  —  7z  =  4 

j)  -3x^  -3  =  0 

2.  Write  the  coefficient  matrix  and  the  augmented  matrix  for  each  of  the  fol¬ 
lowing  systems  of  linear  equations. 


— 3a;i  -f  5a;2 

1 

a) 

X\  -|-  2X2 

=  - 

-4 

4xi  -  X2 

=  - 

-3 

2xi  -f-  X2  -j- 

3a;3 

=  1 

b) 

X2  - 

X3 

+  33^4 

=  -4 

Xi  -f 

5X3 

- 

-  2a;5  =  6 

3 .  Find  the  solution  set  for  the  following  linear  equations. 
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a)  —2xy  +  5x2  -  X3  +  3x4  =  8 

b)  V  —  4w  +  X  +  5p  -h  3z  =  0 

c)  X  —  p  +  6z  =  0 


4.  Solve  the  following  linear  systems  by  the  method  of  substitution. 

.  2x  +  y  =  5 
^  —3x  +  2y  =  3 

4x  -  2y  =  0 

X  +  3y  =  7 

2x  -  3y  -  z  =  6 

c)  X  -\-  by  -  2z  =  12 

-X  +  4y  +  62  =  24 


+ 


6a;2 

X2 


Xi  -j-  X2  +  3x3  =  3 

e)  —2x1  +  X2  +  5x3  =  0 

3xi  +  2x2  8^3  =  3 


— Xi  +  X2  +  3x3  =  3 

f)  — 2xi  +  X2  +  5x3  =  0 

— 3xi  +  2x2  +  8x3  =  4 


5.  Solve  the  following  linear  systems  using  Gaussian  Elimination. 

2x  —  3y  —  z  =  6 

a)  X  +  6y  -  22  =  12 

-X  +  4y  +  62  =  24 


-Xi 

+ 

X2 

+ 

3X3 

=  3 

b)  —  2xi 

+ 

X2 

+ 

5X3 

=  0 

— 3xi 

+ 

2X2 

+ 

00 

CO 

=  3 

-Xi 

+ 

X2 

+ 

3X3 

=  3 

c)  — 2xi 

+ 

X2 

+ 

5x3 

=  0 

— 3xi 

+ 

2X2 

+ 

8x3 

=  4 

Xi 

+ 

X3  + 

II 

CO 

5 

— 

2X2 

— 

CO 

II 

-9 

2xi 

+ 

2X2 

+ 

^3  + 

2x4  = 

18 

2xi 

+ 

X2 

+ 

Xs  + 

II 

12 
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x^ 

+  X2 

+ 

X3  =  9 

e) 

—2xi 

- 

-  X2 

— 

X3  =  -15 

-Xi 

+  X2 

+ 

X3  =  -4 

Ixi 

+ 

2x2 

+ 

X3  +  X4  =  7 

2Xy 

— 

SX2 

+ 

2x3  +  2x4  =  —10 

2xi 

+ 

3X2 

+ 

2x3  -j-  2x4  =  12 

Sxi 

— 

2X2 

+ 

3x2  T  3x2  =  5 

6.  Use  Gauss-Jordan  Elimination  to  solve  the  following  systems. 

Xi 

+ 

2X3  -  5 

a) 

2xi 

+ 

3X2 

+ 

5x3  =  5 

+ 

4X2 

+ 

7X3  =  8 

Xi 

+ 

X2 

+ 

2x3  =  5 

b) 

2xi 

+ 

5X2 

+ 

7X3  =  19 

2xi 

+ 

4X4 

+ 

6x3  =  16 

Xi 

+ 

2X2 

+ 

X3  =  6 

c) 

Xi 

+ 

2X2 

+ 

2x3  =  7 

2xi 

+ 

4X2 

+ 

2x3  =  15 

-Xi 

— 

2X2 

— 

X3  =  -5 

d) 

Xi 

+ 

3X2 

+ 

2x3  =  7 

2xi 

+ 

4X2 

+ 

2x3  =  10 

7.  A  butcher  sells  regular  and  diet  ground  beef.  Regular  ground  beef  is  30% 
fat,  while  diet  ground  beef  is  20%  fat.  One  day  the  butcher  finds  that  she  has  on 
hand  3  pounds  of  fat  and  10  pounds  of  lean  beef  (assume  lean  beef  has  no  fat  in 
it).  The  butcher  wants  to  use  all  the  fat  and  lean  beef  she  has  on  hand.  How  many 
pounds  of  regular  ground  beef  and  how  many  pounds  of  diet  ground  beef  shall  the 
butcher  make  if  she  wants  to  use  all  the  fat  and  all  the  lean  beef  on  hand?[Ref  2] 


8.  Can  the  equation  ax  —  h  always  be  solved  for  xl 

9.  Determine  if  the  following  systems  are  consistent? 

a)  The  2x4  coefficient  matrix  for  the  system  has  two  pivot  columns. 

b)  The  2x4  augmented  matrix  for  the  system  has  the  fourth  column  as  a  pivot 
column. 
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10.  State  whether  the  following  matrices  are  in  row  echelon  form,  reduced  row 
echelon  form  or  neither. 


a) 


10  0-4 
0  10  7 
0  0  1-1 


b) 


1-4  6  5 

0  12-2 
0  0  1-3 


1 

0 

0 

C) 

0 

1 

0 

0 

0 

1 

■  0 

0  ■ 

d) 

0 

0 

■  1 

1 

0  ■ 

e) 

0 

1 

0 

_  0 

0 

0 

■  1 

1 

0  ■ 

f) 

0 

0 

0 

0 

0 

1 

■  2 

-3  4 

0 

4  0 

g) 

0 

0  0 

0 

0  0 

1 1 .  Solve  the  following  systems  of  linear  equations  by  the  method  you  prefer. 

.  —x\  —  2x2  =  6 

2xi  +  6x2  =  3 

, .  xi  -  2x2  =  3 
^  -3xi  +  5x2  =  1 

2xi  +  5x2  +  X3  =  4 

c)  -xi  -  3x2  +  2x3  =  5 

xi  -  3x2  -  4x3  =  -17 

Xi  +  4X2  +3^3=  6 

d)  — Xi  +  2x2  3x3  =  — 8 

6x2  +  4X3  =  —1 
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2x2  +  2;3  =  3 

e)  xx  +  Ax2  +  3x3  =  8 

Xx  +  6X2  +  4x3  =  11 


2xi 

— 

4X2 

+ 

Xs  + 

2X4  : 

1 

f) 

-Xx 

+ 

3X2 

+ 

5X3  - 

X4  : 

— 

6  • 

3xi 

— 

7X2 

— 

4X3  + 

3X4  : 

=:  - 

-5 

2xi 

+ 

2X2 

8 

g) 

2xi 

— 

5X2 

-6 

6xi 

— 

8X2 

3 

Xx 

+ 

2X2 

— 

3X3  = 

0 

h) 

— 3xi 

— 

2X2 

+ 

X3  = 

-4 

— 2xi 

— 

2X3  = 

2 

12 

.  Solve  the  following  homogeneous 

systems  of  linear  equations 

2xi 

X2 

+ 

2X3  = 

0 

a) 

-Xx 

+ 

2X2 

+ 

3X3  = 

0 

3X2 

+ 

8x3  = 

0 

hi 

Xx 

2x2 

+ 

4X3  + 

X4  = 

=  0 

5xi 

+ 

3X2 

+ 

2:3  - 

2x4  = 

=  0 

2xi 

4X2 

+ 

2X3  -f- 

4x4 

0 

— 3xi 

— 

+ 

3X3 

= 

0 

c) 

— 

3X2 

— 

2^3  - 

2x4 

= 

0 

Xx 

+ 

2^2 

+ 

X4 

= 

0 

-Xx 

__ 

2X2 

— 

33^3  + 

3X4 

= 

0 

dl 

Xx  - 

3x2  + 

X3  +  2x4  = 

0 

X2  +  2x^  + 

X4  = 

0 

-Xx 

+ 

2^2 

+ 

2x3  = 

0 

e) 

2xx 

— 

3X2 

= 

0 

— 3xi 

+ 

4X2 

0 

37 


38 


11.  VECTOR  AND  MATRIX  EQUATIONS 


In  this  section  we  will  study  the  notation  and  algebra  of  vectors  and  matrices,  \fec- 
tors  and  matrices  give  us  a  way  to  represent  systems  of  linear  equations  in  a  “shorthand” 
notation  which  is  algebraically  easier  to  work  with  than  the  linear  system  itself  We  began 
to  manipulate  linear  systems  in  matrix  form  when  we  used  the  augmented  matrix.  This  sec¬ 
tion  will  expand  on  basic  algebraic  concepts  of  vectors  and  matrices  and  their  applications 
to  systems  of  linear  equations. 

A.  VECTOR  OPERATIONS 

A  vector,  for  our  purposes,  is  an  ordered  array  of  n  scalars.  We  denote  a  vector 
with  a  lowercase  letter  which  has  an  arrow  over  the  top,  for  example,  v.  We  can  represent 
a  vector  as  a  matrix  of  dimension  n  x  1,  called  a  column  vector,  whose  components  are 
scalars.  We  can  also  represent  the  same  vector  as  a  matrix  of  dimension  1  x  n,  called  a  row 
vector,  whose  components  are  the  same  scalars. 


Example  II.1  The  vector  v  written  as  a  column  vector  and  as  a  row  vector: 


•^1 

V2 


L  '^n  J 

Column  \fector 
(nxl) 

The  components  fi,  U2,  ...u„  are  scalars. 


v=[vi  V2  .  .  .  Vn]  . 

Row  vector 
(Ixn) 


Given  an  n  x  1  vector  v  — 


Vl 

^2 


we  associate  with  v  the  point  (vi,V2,  ...u„)  in 


L  '^n  J 

In  our  studies  we  will  use  column  vectors  unless  otherwise  required. 
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Example  n.2  Below  are  three  vectors  with  different  numbers  of  components: 


■Vfector  iaR^  L  J 

(2x1)  \fectorini?^ 

(3x1) 


Ui 

U2 


L  '^n  J 

\fector  in 
(nxl) 


Two  vectors  are  equal  if  and  only  if  they  have  the  same  components  in  the  same 

order. 


Example  n.3  For  example,  u  =  v,hutu  ^  w,  and  v  ^  w: 


u  = 

3  ■ 

4 

,  U  = 

1 

CO 

1 _ 

,  w  = 

1 - 

CO 

1 

1 _ 

_  -6 
(3x1) 

L-6J 

(3x1) 

(3x1) 

We  should  note  that  a  vector 


3 

4 

-6 


3  4  —6  ]  because  the  vectors  have 


different  dimensions,  even  though  they  have  the  same  components. 

Geometrically,  we  associate  with  v  the  directed  line  .segment  in  R'^  with  initial  point 
at  the  origin  and  terminal  point  at  {vi,V2,  —Vn)  •  For  example,  we  can  associate  avector  in 
E?  with  a  point  in  the  Cartesian  plane.  If  we  draw  a  directed  line  segment  from  the  origin 
to  the  point  (ui ,  v^),  we  get  the  conventional  visualization  of  a  vector. 


Example  n.4  The  point  (x,  y)  in  the  Cartesian  plane  can  be  associated  with  the  vector 


X 

y 


,  see  figure  1. 


1.  Vector  Addition  and  Subtraction 

\fectors  can  be  added  and  subtracted  in  the  following  manner.  Given  two  vectors,  if 
the  vectors  have  the  same  number  of  components,  then  addition  and  subtraction  is  computed 
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Figure  1.  Plot  of  the  \fector  [x  y] 

component-wise. 


X  = 

Xi 
.  ^2 

= 

i  1 

to 

,  x  +  y  = 

+  y\ 

_  X2  +  y2  _ 

X  = 

Xi 

.  ^2  . 

I  1 

1 _ 1 

II 

1 

-  y\ 
_X2-y2 

If  the  vectors  do  not  have  the  same  number  of  components,  the  sum  and  difference  are 
undefined. 

Graphically,  we  can  use  the  parallelogram  rule  to  visualize  the  sum  of  two  vectors. 
In  the  Cartesian  plane,  if  the  origin  and  the  points  associated  with  the  vectors  are  three 
vertices  of  a  parallelogram,  the  sum  of  the  two  vectors  is  a  vector  associated  the  point  which 
would  be  the  fourth  vertex  of  the  parallelogram,  see  figure  2. 


■  3  ■ 

■  -1  ■ 

Example  n.5  Given  x  = 

4 

5 

,  y  = 

2 

6 

0 

7 

6 

5 


2  ■ 

4  ' 

x  +  y  = 

6 

11 

,  ^-y  = 

2 

-1 

X  —  z  and  y  -I-  £are  undefined. 
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Figure  2.  Illustration  of  the  Parallelogram  Rule 

2.  Vector  Scalar  Multiplication 


Given  a  vector  v  = 


Vi 

V2 


and  a  scalar  k,  we  can  compute  kvhy  multiplying  each 


L  Vn  J 

component  of  u  by  the  scalar  k: 


1 

r  kvi  1 

Vi 

kV2 

V2 

• 

- 

Vn  _ 

.  kVn  . 

When  we  subtract  a  vector  y  from  another  vector  v,  we  are  actually  adding  (—1)  y  to  v,  that 

is, 

v-y  =  v  +  {-l)y. 

Graphically,  kv  transforms  the  vector  v  as  follows.  If  0  <  /c  <  1 ,  then  k  contracts  the  vector 
V.  If'O  >  k  >  —1,  then  k  contracts  the  vector  v  and  points  the  associated  directed  line 
segment  in  the  opposite  direction.  If  A;  >  1,  then  k  dilates  the  vector  u.  If  A;  <  -1,  then  k 
dilates  the  vector  v  and  points  the  associated  directed  line  segment  in  the  opposite  direction, 
see  figure  3. 


42 


Figure  3.  \fector  Scalar  Multiplication 
Example  n.6  Compute  the  scalar  multiplication  kv  : 


Solution:  A:  =  6,  v  = 

■  0  ■ 

6 

II 

■  6-0  ■ 
6-6 

0  ■ 

36 

5 

6-5 

30 

3.  Victor  Multiplication 

\fector  multiplication  is  commonly  called  the  dot  product  or  the  scalar  product.  The 
dot  product  of  two  vectors  requires  the  vectors  to  have  the  same  number  of  components. 
The  result  will  be  a  scalar,  not  a  vector,  ergo  the  name  scalar  product.  Given  two  vectors: 


Xi  ' 

■  Vi  ' 

y2 

■ 

,  and  y  = 

,  we  define  the  dot  product  as 

Xn  - 

-  Un  - 

^  '  y  —  '  Vk  =  XiPi  +  X2y2  +  •  •  •  +  XnVn- 

*  ^  We  know  that  multiplication  of  real  numbers  is  commutative,  so  we  can  rewrite  this 
equation  as: 
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x-y  =  XiVi  +  X2y2  +  •  •  •  +  XnVn- 


=  yiXi  +  y2X2  H - h  ynXn 

n 

fc=l 

=  y-x. 

This  demonstrates  the  property  that  vector  multiplication  is  commutative,  x-y  =  y-x. 
Example  n.7  Consider  the  vectors: 


■  2  ■ 

■  -2  ' 

■  0  ■ 

X  = 

3 

4 

II. 

1 

3 

,  z  = 

7 

6 

5 

x-y  =  2--2  +  3-l+4-3  =  ll. 

y  •  ^is  undefined,  since  the  vectors  do  not  have  the  same  number  of  components. 

The  norm,  or  magnitude,  of  a  vector  is  defined  to  be  the  square  root  of  the  dot 
product  of  the  vector  with  itself.  We  denote  the  norm  of  a  vector  x  by  writing  \x\ .  We  can 
use  the  dot  product  to  calculate  the  norm  of  a  vector,  and  to  calculate  the  angle  between  the 
directed  line  segments  associated  with  two  vectors.  The  norm  is  defined  by: 

\x\  =  Vx  •  X. 

We  can  calculate  the  norm  of  any  vector  regardless  of  the  dimensions  of  the  vector. 
Example  11.8  Given  the  vectors: 


■  2  ■ 

■  -2  ■ 

■  0  ■ 

X  — 

3 

,  y  = 

1 

7 

6 

4 

3 

L  J 

5 

compute  \x\,  \y\,  and  |f| . 

Solution: 

\x\  =  V2-2  +  3-  3  +  4-  4  =  «  5.39, 

M  =  ^-2  •  -2  +  1  •  1  +  3  •  3  =  VU  ^  3.74, 
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1-^  =  \/0T7^T+6^^6T^  =  10.49. 


We  can  use  the  dot  product  and  the  norm  to  compute  the  angle  between  the  two 
directed  line  segments  associated  with  the  vectors  x  and  y  using  the  Law  of  Cosines,  which 
is  defined  by; 


6  is  the  smallest  positive  angle  between  the  two  directed  line  segments  associated  with  the 
vectors  x  and  y,  see  figure  4. 


Figure  4.  Law  of  Cosines,  Angle  Between  Wctors 


Example  n.9  Given  the  vectors: 


■  2  ■ 

r-2i 

X  = 

3 

4 

,  y  = 

- 1 

T— 1  CO 

_ 1 

find  the  angle  between  the  associated  directed  line  segments: 

Solution: 


cosO 


x-y 

1^1  \y\ 

11 

(5.39)  (3.74) 
11 

20.16 
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.55. 


9  =  arccos(.55)  «  56.93°. 


We  say  two  vectors  are  orthogonal  if  their  dot  product  is  equal  to  zero. 


Example  n.10  Determine  which  vectors  are  orthogonal. 


X  = 

1 

C^l  CO 

1 _ 

,  w  = 

1 

1 

_ 1 

,  u  = 

■  -2  ■ 
-1 

L-iJ 

L  7j 

2 

=  — 8  +  15  —  7  =  0  (orthogonal), 

:e  m  =  — 4  —  3  —  2  =  — 9  (not  orthogonal), 
u;u  =  8-  5  +  14  =  17  (not  orthogonal). 

Let’s  calculate  the  angle  between  the  directed  line  segments  associated  with  the  or¬ 
thogonal  vectors  x  and  w. 


Example  n.11  Given  x  = 


2 

3 

-1 


and  w  = 


-4 

5 

7 


,  use  the  law  of  cosines  to  calculate 


the  angle  between  the  associated  directed  line  segments; 

Solution: 


cos  9 


X  •  w 

\x\  |u;| 

0 

(3.74)  (9.49) 
0 


9  =  arccos(O)  =  90° 

From  this  example  we  see  that  orthogonal  vectors  form  right  angles. 


^  ^  4.  Wctor  Form  of  the  Solution  to  a  Linear  System 

Now  that  we  know  a  vector  is  an  ordered  array  of  scalars  and  the  solution  to  a  system 
of  linear  equations  is  an  ordered  set  of  values,  we  have  a  new  way  to  write  the  solution  to  a 
system  of  linear  equations. 
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Example  n.12  Given  the  linear  system, 


3x2  15x3  —  T 

6x1  +  2X2  +  18x3  =  -8  ’ 

the  general  solution  is 

(  xi  =  -12/7S-5/7 

J  a;2  =  -27/7S-13/7 
[  a;3  =  s. 

We  can  also  write  the  general  solution  in  vector  form; 

'  Xi  1  r  -12/7S-5/7  ]  r -12/7  1  f  -5/7' 

X2  =  -27/7S-13/7  -27/7  +  -13/7 

.^3j[  s  Jli  0 

B.  MATRIX  OPERATIONS 

A  matrix  is  a  rectangular  array  of  numbers.  We  denote  a  matrix  with  a  capital  letter 
and  the  entries  of  a  matrix  are  denoted  with  lowercase  letters.  If  we  have  a  matrix  A  with 
m  rows  and  n  columns  we  say  that  A  is  an  m  x  n  matrix.  An  entry  in  the  matrix  A  is 
represented  as  aij,  where  i  and  j  denote  the  position  of  the  entry  in  the  matrix  (row  i  and 
column  j). 


On 

021 

^12 

022 

Ol3 

O23 

^In 

^2n 

- 

Om2 

Om3 

‘  ^mn  - 

A  is  m  (mxn)  matrix  with  entries  aij 

Given  two  matrices  A  and  B,  we  say  the  matrix  A  is  equal  to  the  matrix  B  if, 
and  only  if,  =  bij  for  all  z,  j.  In  the  remainder  of  this  section  we  will  treat  matrices 
as  algebraic  objects  and  learn  howto  perform  matrix  addition,  subtraction,  multiplication, 
and  scalar  multiplication.  We  will  learn  some  properties  of  matrix  operations  and  discuss 
special  types  of  matrices. 

1.  Matrix  Addition  and  Subtraction 

Two  matrices  can  be  added  together  provided  they  have  the  same  dimensions.  Ad- 
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dition  is  done  entry-wise.  Given  two  matrices  A  and  B,  both  of  which  are  m  x  n  matrices, 
matrix  addition  is  defined  as  follows: 


C  =  A  +  B,  where  Cy  =  a^-  -f  6^  for  each  i,j. 


C  is  also  an  m  X  n  matrix. 


Example  n.13  Compute  A  +  B: 

Solution: 


Similarly,  one  matrix  can  be  subtracted  from  another  matrix  provided  they  have  the 
same  dimensions.  Subtraction  is  also  done  entry-wise.  Given  two  matrices  A  and  B,  both 
of  which  are  m  X  n  matrices,  matrix  subtraction  is  defined  as  follows: 

C  —  A  —  B,  where  c^-  =  aij  —  bij  for  each  i,j. 

C  is  also  an  m  X  n  matrix. 


A  = 


4  1  6 
-13  2 

(2x3) 


B  = 


1  0  2 
3-2  5 

(2x3) 


A  +  B  - 


5  1  8 
2  17 

(2x3) 


Example  n.14  Compute  A  —  B: 
Solution: 


A  = 


4  1  6 
-1  3  2  J  ’ 

(2x3) 


B  - 


1  0  2 
3  -2  5J’ 

(2x3) 


A-B^ 


3  1  4 

-4  5  -3 

(2x3) 


If  two  matrices  do  not  have  the  same  dimensions,  matrix  addition  and  matrix  sub¬ 
traction  are  undefined. 


2.  Matrix  Scalar  Multiplication 

We  can  multiply  an  m  x  n  matrix  A  by  a  scalar  k  in  the  same  manner  we  performed 
vector  scalar  multiplication.  Given  an  m  x  n  matrix  A  and  a  scalar  k,  A:A  is  an  m  x  n 
matrix  with  the  entries  kaij  for  each  aij  in  the  matrix  A.  Matrix  scalar  multiplication  can 
be  performed  on  any  matrix  regardless  the  dimensions  of  the  matrix. 

Example  n.15  Consider  the  matrix  A  and  the  scalar  k  : 
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Solution 


4  1  6 
-1  3  2  J  ’ 

(2x3) 


k  =  2. 


kA  =  2 


4 

1 

6  ■ 

8 

2 

12  ■ 

-1 

3 

2 

-2 

6 

4 

When  we  subtract  a  matrix  B  from  a  matrix  A,  we  actually  add  (-1)  B  to  A. 

A- B  =  A+{-l)B. 

Remember,  A  and  B  must  have  the  same  dimensions  to  perform  addition  and  subtraction. 

3.  Matrix  Multiplication 

Not  only  can  we  multiply  a  matrix  by  a  scalar,  but  we  can  also  multiply  a  matrix  by  a 
matrix.  Unlike  matrix  addition  and  subtraction,  matrix  multiplication  is  not  done  entry-wise 
and  the  dimensions  of  the  matrices  may  or  may  not  be  the  same.  Matrix  multiplication  is 
performed  by  taking  the  dot  product  of  the  row  vector  in  the  ith  row  of  the  first  matrix  with 
the  column  vector  in  the  jih  column  of  the  second  matrix  to  get  the  ij  entry  of  the  resulting 
matrix.  Since  the  dot  product  of  two  vectors  requires  that  the  vectors  have  the  same  number 
of  entries,  the  number  of  columns  in  the  first  matrix  must  equal  the  number  of  rows  in  the 
second  matrix.  The  resulting  matrix  will  have  the  same  number  of  rows  as  the  first  matrix 
and  the  same  number  of  columns  as  the  second  matrix  in  the  product.  Let’s  take  a  closer 
look.  Let  ^  be  an  m  X  n  matrix  and  let  5  be  an  n  x  p  matrix,  then 

^  B  =AB 

(mxn)(nxp)  (mxp) 

The  dimensions  of  the  matrices  must  have  the  following  relationship  in  order  to  perform 
matrix  multiplication, 

dimensions  of  AB  ^  {m  x  n){n  x  p)  =  {m  x  p). 

same 

V - ^ ^ . 

dimensions  of  resulting  matrix 
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We  define  the  product  as  follows: 


C  =  AB,  where  the  entries  of  C  are  c^-  =  Yl=x  ^^ikhj  for  each  i,  j 


Example  n.16  Let  A  =  ^ 

matrix  and  5  is  a  (2  x  3)  matrix, 


and  B 


1  0  2 
3-2  5 


Since  is  a  (2  x  3) 


dimensions  of  AB  =  (2  x  3)(2  x  3). 


Since  the  dimensions  of  A  and  B  do  not  have  the  right  relationship  for  matrix  multiplication, 
AB  is  undefined. 


Example  n.17  Let  A  = 


4  1  3 
-13  2 


and  B  = 


6  1 
4  2 
0  5 


dimensions  of  AB  =  (2x  3)(3  x  2)  =(2x2). 


dimensions  of  resulting  matrix 


AB  = 


4  1  3 
-13  2 


1 

I — 

CO 

1 _ 

4  2 

.  0  ^ 

4-6  +  1-4  +  3-0  4-1  +  1-2  +  3-5 

-1-6  +  3-4  +  2-0  -1-1  +  3-2  +  2-5 

28  21  ■ 

6  15  ■ 


Unlike  vector  multiplication,  matrix  multiplication  is  not  a  commutative  operation. 
So  in  general, 

AB  ^  BA. 


Example  n.l8  Let  A  = 


4  1  3 
-13  2 


and  B  = 


while  BA  is  a  (3  x  3)  matrix. 


6  1 
4  2 
0  5 


Then  AB  is  a  (2  x  2)  matrix. 


BA 


'6  1  ■ 

_ 

4  2 

4  13' 

0  5 

-13  2 
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6-4+1--1  6-1  +  1-3  6-3  +  1-2' 

=  4-4  +  2--1  4-1  +  2-3  4-3  +  2-2 

_0-4  +  5--l  0-1  +  5-3  0-3  +  5-2 

'  23  9  20  1 

=  14  10  16 

_  -5  15  10 

4.  Properties  of  Matrix  Operations 

Given  scalars  a  and  b  and  matrices  A,B,  and  C,  with  dimensions  such  that  the 
operations  below  are  defined,  the  following  properties  hold: 

1.  A  +  B  =  B  +  A  Commutative  property  of  addition. 

2.  A  +  (B  +  C)  =  {A  +  B)  +  C  Associative  property  of  addition. 

3.  A(B  +  C)  =  AB  +  AC  Left  distributive  property  over  addition. 

4.  {A  +  B)C  =  AC  +  BC  Right  distributive  property  over  addition. 

5.  A(BC)  =  (AB)C  Associative  property  of  multiplication. 

6.  a{B  +  C)  =  aB  +  aC 

7.  (a  -)-  6)C7  =  ciC  +  bC 

8.  {ab)C  =  a{bC) 

9.  a(BC)  =  (aB)C  The  order  of  B  and  C  must  be  maintained. 

5.  Partitioned  Matrices 

At  the  beginning  of  this  section  we  said  an  m  x  n  matrix  A  has  m  rows  and  n 
columns: 

ail  ai2  •  •  •  ai„ 

022  •  •  •  a2n 

_  L  0^2  •  •  •  a^nn  . 

We  can  think  of  an  m  x  n  matrix  as  a  matrix  which  consists  of  n  column  vectors  each  with 


m  components: 


A  [  *^1  *^2  '  ‘  ‘  ]  • 

We  can  also  think  of  an  m  x  n  matrix  as  a  matrix  which  consists  of  m  row  vectors,  each 
with  n  components: 


L  J 

We  have  changed  our  view  of  a  matrix  from  a  rectangular  array  of  numbers  to  an  array  of 
vectors,  either  column  vectors  or  row  vectors.  Can  we  go  one  step  further  and  consider 
a  matrix  to  be  an  array  of  matrices?  It  turns  out  that  we  can.  An  m  x  n  matrix  can  be 
partitioned  into  smaller  matrices,  which  we  shall  call  submatrices  or  blocks,  by  separating 
the  entries  in  the  matrix  using  horizontal  and  vertical  lines  between  the  rows  and  columns 
of  the  matrix.  Given  a  matrix 


Oil 

021 

O'Sl 


fll2 

O22 

0-32 


fll3 

023 

O33 


014 

O24 

O34 


Ol5 

O25 

O35 


O16 

026 

O36 


J 


we  can  rewrite  the  matrix  A  as  a  partitioned  matrix  consisting  of  submatrices 


A  = 

On 

O21 

012 

O22 

Ol3 

O23 

Ol4 

O24 

Ol5 

025 

016 

026 

_ 

^11 

^21 

M2 

^13 

O31 

032 

033 

034 

035 

O36 

^22 

-^23 

where  An  = 


On  012 

021  022 


Ai2  — 


Ol3  Oi4  Oi5 

023  024  025 


Aiz  — 


O16 

026 


^21  =  [  031  032  ]  ,  A22  =[033  034  035  ]  ,  and  A23  =  [035]. 

The  partitioning  of  A  is  not  unique.  We  can  rewrite  the  matrix  A  as  a  different  parti¬ 
tioned  matrix  by  choosing  a  different  arrangement  of  the  horizontal  and  vertical  lines.  When 
we  write  the  matrix  A  as  a  matrix  consisting  of  row  vectors, 


ail 

012 

Oi3 

Ol4 

Ol5 

O16 

' 

A  = 

021 

022 

O23 

O24 

O25 

026 

^2 

.  031 

032 

O33 

O34 

O35 

O36  . 

-  . 
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we  are  actually  partitioning  the  matrix  A  into  submatrices, 


A  = 


^11 

A21 

-^31 


Similarly,  we  can  partition  A  into  submatrices  which  are  column  vectors. 


A  [  Cl  C2  C3  C4  C5  Cg  j  —  1^  All  -^12  ^13  -^14  -^IS  .^16  j  . 

Example  n.19  Let  A—  3547- 

a)  Partition  A  into  a  matrix  with  two  submatrices  which  are  row  vectors. 


Solution: 


rj_ 

4 

to 

1 

CO 

1 

h- * 

_ 1 

coi 

5 

4 

7 

.  ^21  J 

b)  Partition  A  into  a  matrix  with  four  submatrices  which  are  column  vectors. 

Solution: 


A  = 


[  1 

4 

2 

_ \ 

1 - 

CO 

5 

4 

- 1 

—  [  All  Ai2 


il3 


^14  ] 


c)  Partition  A  into  a  matrix  with  at  least  three  submatrices/blocks. 

Solution: 

^11  -^12 
^21  ^22 

Not  only  can  we  partition  matrices,  but  we  can  also  treat  partitioned  matrices  as 
algebraic  objects  just  as  we  do  matrices  which  are  not  partitioned.  This  is  useful  when 
we  are  dealing  with  large  matrices  on  a  computer.  Instead  of  storing  the  entire  matrix  in 
the  computer  memory,  we  can  store  the  partitions  and  only  call  the  necessary  partition  into 
memory  to  complete  a  calculation. 


1  4  2  6' 

3  15  4  7 


a.  Addition  and  Subtraction  of  Partitioned  Matrices 

Addition  and  subtraction  of  partitioned  matrices  is  performed  in  exactly  the  same 
way  as  addition  and  subtraction  of  non-partitioned  matrices.  The  submatrices  must  have 
dimensions  such  that  addition  and  subtraction  are  defined.  • 
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Example  n.20  Let  A  = 


1  2  5  7  3  2 

2  6  3  .  ^  _  5  16 

117  >  ^  -  6  12 

9  0  4  0  9  3 


Let  A  and  B  be  partitioned  as  follows; 


1 

2  5 

2 

6  3 

1 

1  7 

9 

0  4 

-^11  Ai2 
^21  -422 


7 

3  2 

5 

1  6 

6 

1  2 

0 

9  3 

^11  Bi2 
B21  B22 


a)  Calculate  A  +  B. 


Solution: 


A  B  = 


All 

Ai2 

A21 

A22 

All 

+  B11 

A21 

+  ^21 

8 

5  7 

7 

7  9 

7 

2  9 

9 

9  7 

•^11  Bi2 
■621  B22 


8  5  7 
7  7  9 
7  2  9 

9  9  7 

Compare  this  result  with  adding  A  +  B  when  A  and  B  are  not  partitioned.  Is  the  result  the 
same?  It  should  be. 


b)  Compute  A  —  B. 
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Solution: 


A-B 


All 

4i2 

■  B 

_  ^21  ^ 

^22 

B 

All  — 

Bn 

^12  — 

A21  — 

B21 

A22  — 

■  -6 

-1 

■ 

-3 

5 

-5 

0  5 

9 

-9  1 

■  -6  - 

-1 

3  ■ 

-3 

5  - 

-3 

-5 

0 

5 

9  - 

-9 

1 

Bn 

B22 


Compare  your  solution  with  A  -  B  when  A  and  B  are  not  partitioned.  Is  the  result  the 
same?  Again,  it  should  be. 


We  see  that  the  sum/ difference  of  two  partitioned  matrices  is  equal  to  the  sum/difference 
of  the  corresponding  submatrices.  The  matrices  must  have  the  same  dimensions  with  re¬ 
spect  to  the  submatrices  and  the  submatrices  must  have  the  same  dimensions  with  respect 
to  the  elements.  Using  our  example,  A  and  B  are  both  2x2  partitioned  matrices  each  with 
corresponding  submatrices  which  have  dimensions: 


All  and  Bu  are  2x1,' 
Ai2  and  B12  are  2  x  2, 
A21  and  B21  are  2  X  1 , 
A22  and  B22  are  2  X  2. 


b.  Scalar  Multiplication  of  Partitioned  Matrices 


3 

Multiplying  a  partitioned  matrix  by  a  scalar  is  the  same  as  multiplying  each  subma- 

^11  Ai2  1  1  •  1  u 

,  and  c  IS  any  scalar,  then 


trix  by  that  same  scalar  If  A 


A- 


•21 


i22 


cAii  cyli2 
CA21  ^^22 
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Example  n.21  Let  A  = 

Compute  cA. 

Solution: 


1  2  3 

4 


^11  Ai2 
■^21  A22 


and  let  c  =  2. 


cA  = 


cAii  cAi2 
CA21  CA22 

2-1  I  2-2  2-3  ■ 
2 • 4  I  2-5  2-6 


2 

4 

6 

8 

10 

12 

c.  Multiplication  of  Partitioned  Matrices 


Let  A  be  an  m  X  n  matrix  and  let  B  be  an  n  x  r  matrix.  If  the  submatrices  have 
dimensions  such  that  multiplication  is  defined,  the  submatrices  can  be  multiplied  exactly  as 
we  perform  matrix  multiplication. 


Example  n.22  Let  A  = 


1  1  1 
2  1  2 


-1 

-1 


—  All  Ai2  ]  , 


and  let  B  = 


4 

2 

1 


-2  1 
3  1 

1  2 


fill 

B22 


1  2  3 

Compute  AJ5  using  submatrix  multiplication. 

Solution: 


Bii 

B22 

—  [^ii-Bii  +  A12B22] 


AB  —  [  All  Ai2  ] 


1  1  1 
2  12 

7  2  4 
12  1  7 

6  0 
11  -1 


■4  -2  1  ■ 

2  3  1 

+ 

-1 

1 

- 

1  1  2 

+ 


-1 

-1 


-2  -3 
-2  -3 


[1  2  3] 
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In  the  example,  we  multiply  the  submatrices  of  A  and  B  exactly  as  we  perform 
matrix  multiplication. 


AB  —  [  All  ^12  ] 


Bn 

B22 


—  +  A12B22] 


But  the  multiplication  of  A  and  B  is  only  defined  if  the  submatrices  have  dimensions  such 
that  the  submatrix  multiplication  is  defined. 


The  dimensions  of  An  Bn  =  (2  x  3)  (3  x  3)  =  (2  x  3) . 

The  dimensions  of  A12B22  =  (2  x  1)  (1  x  3)  =  (2  x  3) . 

Finally,  the  resulting  submatrix  products  must  have  dimensions  such  that  addition  is  defined. 

The  dimension  of  AnBn  +  ^12^22  =  (2  x  3)  +  (2  x  3)  =  (2  x  3) . 


6.  Special  Matrices 

A  square  matrix  is  a  matrix  in  which  the  number  of  rows  is  equal  to  the  number  of 
columns.  The  dimension  of  a  square  matrix  A  is  denoted  n  x  n  and  we  say  a  square  matrix 
of  dimension  n  x  n  has  order  n. 


A  = 


Q^ii  ai2  ai3  ai4 

CI2I  ^22  (^23  ^24 

^31  ^^32  0,34 

^41  ^42  ^^^43  <^44 

(4x4) 


A  is  a  4  X  4  matrix  of  order  4.  The  main  diagonal  of  A  consists  of  the  entries  an ,  a22,  033, 
044,  underlined  in  the  matrix  A  above.  Only  square  matrices  have  a  main  diagonal. 

The  transpose  of  a  matrix  A,  denoted  Af,  is  a  matrix  where  the  columns  of  A  are 
the  rows  of  Af  and  the  rows  of  A  are  the  columns  of  A^.  If  A  is  an  m  x  n  matrix,  then  A^ 
will  an  n  X  m  matrix. 


Example  n.23 


Let  A  = 


4  1  3 
-13  2 

(2x3) 


then  A^  = 


4  -1 
1  3 

3  2 

(3x2) 
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Since  a  vector  is  also  a  matrix,  it  is  easy  to  see  that  the  transpose  of  a  row  vector  is 
a  column  vector  and  the  transpose  of  a  column  vector  is  a  row  vector. 

Example  11.24  Consider  the  column  vector  x  : 

■  3  ■ 

x=  4  and:^=[3  4  5]. 

5 

The  transpose  of  a  matrix  has  some  interesting  properties. 


6  0 
=  4  8 

7  9 

=  {A  +  Bf. 


3.  {A~Bf  =  A^~B^. 

4.  {A^Y  =  A. 

5.  {cAY  =  c(A)^,  where  c  is  a  scalar. 


Try  to  make  up  some  simple  examples  on  your  own  to  see  how  properties  3,  4,  and 
5  work.  ‘ 

An  n  X  n  matrix  is  a  symmetric  matrix  if  A  =  A^.  The  symmetry  is  across  the  main 
diagonal.  A  symmetric  matrix  is  always  a  square  matrix. 


‘  2  3  4  ' 

’  2  3  4  ' 

Example  n.27  Let  A  = 

j  1  A  •  .  • 

3  15 

4  5  3 

and  A^  = 

3  1  5 

4  5  3 

the  matrix  A  is  a  symmetric  matrix. 


.  Since  A  =  A^,  we  say 


The  zero  matrix^  denoted  0,  is  an  m  x  n  matrix  in  which  all  entries  are  O’s.  The 
following  are  some  properties  of  arithmetic  with  the  zero’  matrix.  Given  matrices  which 
have  dimensions  such  that  the  operations  are  defined; 

1.  A+0  =  0+A  =  A. 

2.  A-A  =  0. 

3.  0-A  =  (-l)A. 

4.  0A  =  0. 

5.  A0  =  0. 


Example  11.28  The  following  are  examples  zero  matrices; 


O 

O 

1 - 1 

o  o  o 

1 _ 1 

o 

o 

o 

o 

O 

o 

5 

5 

0  0  0  0 

By  property  l,we  can  conclude  the  zero  matrix  is  the  additive  identity  for  matrices. 
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*1231  [OOO' 

Example  11.29  Let  A  =  2  4  6  ,  and  0  =  0  0  0  .  Then 

[35lJ  [oOO 

■  1  2  3  1  r  0  0  0  ■ 

A  +  0  =  246  +  000 

35lJ  [000 

■  1  2  3 

=  2  4  6 

3  5  1 

=  A. 


The  additive  inverse  of  an  m  x  n  matrix  A  is  the  matrix  (-1)  A  such  that  A  + 
(— 1)  A  =  A  —  A  =0.  This  is  property  2. 


C.  EXERCISES 


1 .  Determine  the  dimensions  of  the  resulting  matrix  if  A  is  a  2  x  4  matrix,  B 
is  a  4  X  6  matrix,  and  C  is  a  6  x  2  matrix. 

a)  AB 
h)CA 

c)  AC 

d)  BC 

e) BA 


1 1  r -3  ■ 

3  0 

4  ,  r  =  1 

2  2 

5  -4 


2.  Let  X  — 


Using  the  vectors  above  calculate  the  following: 

a) x  +  y 

b) z  +  t 

c) y  +  t 

d)  X  •  X 

e) y-t 

f)  z  -  t 

g)  Calculate  the  magnitude  of  z. 

h)  Calculate  the  angle  between  x  and  y. 
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i)  Calculate  5t. 


3.  Let  A  = 


-1  3 
2  4  ’ 


B  = 


0  2-1 
6  3  5 


1 

2 

3  ■ 

D  = 

-2 

1 

0 

,  E  = 

■  -2  -1  ■ 

0 

0 

0 

1  3 

C  = 


2  0 
0  1 
3  1 


-1  2 
4  1  ’ 


) 


2 

0  3 


a)  Calculate  the  matrix  products  AB,  BC,  BD,  CA,  CB,  DC. 

b)  Write 

c)  Write  . 

d)  Writes^. 

e)  Calculate  (EF)'^. 

f)  Calculate  F'^E^ . 

g)  Find  the  additive  inverse  for  matrix  A. 

h)  Find  the  additive  inverse  for  matrix  C. 

i)  What  are  the  scalars  on  the  main  diagonal  for  matrix  F? 

j)  What  are  the  scalars  on  the  main  diagonal  for  matrix  B1 


4.  Consider  the  matrices: 


r  -3 

0  1 

A  = 

-1 

2 

,  B  = 

3  1 

,  c  = 

1 

-4 

2 

4 

1 

0  -2 

0 

6 

5 

D  = 

'  4  5  2  ' 

-3  0  1 

,  E  = 

'6  13' 

-1  5  2 

-12  4 

4-2  3 

Compute  the  following; 


a)AB 
h)D  +  E 

c) D-E 

d) DE 

e) ED 

f) -7B 

g) 3C-D 

h)  {3E)D 

i)  A{BC) 

j)  (4F)C'  +  2J5 
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5.  Let  A,  B,x,  and  y  be  the  matrices: 


Find  each  of  the  following  expressions,  or  state  why  it  does  not  exist. 


a) AB 

b)  Ax 

c) A^y 
A)x-y 


6.  Let  A,  B,C,  x,  and  y  be  the  matrices: 


Find  the  following  expressions  or  state  why  the  expression  does  not  exist. 

a)  AC 

b)  AB  + 

c) x-y 

d) 3x  +  B 


1.  True  or  False  (Explain  your  answer.) 

a)  If  matrices  A  and  B  have  dimensions  such  that  AB  exists,  then  BA  exists. 

b)  If  A,  5 ,  and  C  have  dimensions  such  that  addition  is  defined,  then  {A  +  B)+C 
A+{B  +  C). 

c)  If  A  and  B  are  square  matrices,  AB  =  BA. 
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8.  Which  pairs  of  vectors  are  orthogonal? 


For  each  pair  of  vectors,  either  show  that  they  are  orthogonal,  or  compute  exactly 
the  cosine  of  the  angle  between  the  associated  directed  line  segment. 


10.  Let  A,  B,  and  C  be  the  partitioned  matrices: 

'3  211  ri2-2‘ 

A=  J^-1  0  ,  -1  0  3  ,  ^=[2  -1  1] 

L  -3  1  2  J  [  _1  _3  I’  J 

Compute: 

a)AB 
h)A  +  B 
c)BC 


11.  Perform  each  of  the  following  partitioned  matrix  multiplications. 

■  1  -1  1 

[12  1  -1  1  2  3 

^^  0  3  -1  0  0  -1 

[  4  -3 


[42] 
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12.  A  student  taking  4  classes  will  study  for  the  classes  as  follows: 


Class 

Days  to  study  class 

I 

Monday,  Wednesday,  Friday 

II 

Monday,  Tuesday,  Thursday 

III 

Tuesday,  Wednesday,  Thursday 

IV 

Monday,  Wednesday,  Friday 

The  student  will  study  a  fixed  length  of  time  for  each  class  in  each  session. 


Class 

Hours  Per  Study  Session 

I 

2  hours 

II 

3  hours 

III 

i  hour 

IV 

L-’ 

3  hours 

How  many  hours  will  the  student  study  each  weekday?  How  many  total  hours  will 
the  student  study  each  week?  (Hint;  Develop  a  matrix  showing  the  days  the  student 
studies  for  each  class  by  placing  a  1  in  the  matrix  if  the  student  studies  the  class 
on  that  day  and  a  0  in  the  matrix  if  the  student  does  not  study  the  class  on  that  day. 
Develop  a  vector  showing  the  hours  per  session  the  student  studies  for  each  class. 
Complete  the  matrix  vector  multiplication  to  find  the  hours  the  student  studies  each 
day.) 

13.  A  truck  company  performs  three  types  of  services;  delivery  of  supplies, 
transport  of  personnel,  and  maintenance  services.  The  number  of  trucks  required 
of  one  performance  of  each  service  is: 


Service 

□ 

Number  of  Trucks  Required  for  One  Performance  of  Service 

Supply  Delivery 

3  trucks 

Troop  Transport 

8  trucks 

Maintenance  Services 

2  trucks 

The  number  of  times  each  service  is  performed  each  day  is: 


Day/Service 

Supply 

Troop 

Maintenance 

Monday 

3 

1 

1 

Tuesday 

2 

2 

1 

Wednesday 

3 

2 

1 

Thursday 

4 

1 

1 

Friday 

2 

3 

i 

How  many  workers  are  needed  each  weekday  if  each  service  requires  2  workers 
every  time  the  service  is  performed? 
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14.  The  division  budget  officer  must  make  annual  budget  estimates.  The  divi¬ 
sion  has  3  brigades,  each  of  which  will  conduct  training  exercises.  The  number  of 
exercises  each  brigade  will  conduct  in  a  fiscal  quarter  is: 


Brigade/Fiscal  Quarter 

IstQtr 

2nd  Qtr 

3rd  Qtr 

4th  Qtr 

1st  Brigade 

2 

1 

1 

2 

2nd  Brigade 

1 

2 

1 

1 

3rd  Brigade 

2 

0 

1 

2 

For  each  brigade  an  estimate  is  given  for  expenses  ( in  $1,000)  incurred  in  a  single 
training  exercise  for  training  equipment,  fuel,  repair  parts,  and  meals. 


Expense  ($1,000)/Brigade 

1st  Brigade 

2nd  Brigade 

3rd  Brigade 

Equipment 

50 

45 

60 

Fuel 

200 

250 

200 

Repair  Parts 

350 

400 

300 

Meals 

50 

45 

60 

The  division  budget  officer  wants  to  consolidate  the  estimated  annual  budget  infor¬ 
mation  in  a  single  table  showing  the  total  expenses  per  quarter  for  each  exercise 
expense  (equipment,  fuel,  repair  parts,  meals)  and  the  total  annual  cost  for  each 
exercise  expense.  Show  how  the  budget  officer  would  make  this  table? 
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in.  MATRICES  AND  SYSTEMS  OF  LINEAR  EQUATIONS 


Now  that  we  understand  how  to  perform  algebraic  operations  on  matrices,  we  can 
begin  to  look  at  the  relationships  between  systems  of  linear  equations  and  matrices,  and 
apply  matrix  operations  to  the  linear  systems.  In  this  chapter  we  will  discuss  two  new 
forms  for  a  system  of  linear  equations:  the  vector  equation  consisting  of  several  vectors 
and  the  matrix  equation  consisting  of  a  combination  of  matrices  and  vectors.  Using  these 
new  forms  for  linear  systems,  we  will  then  explore  the  concepts  of  linear  combination,  span, 
linear  independence,  and  linear  transformation. 

A.  MATRIX  AND  VECTOR  EQUATIONS 

Matrix  multiplication  is  directly  applicable  to  systems  of  linear  equations.  Given  a 
system  of  linear  equations; 

dllXi  +  ai2X2  +  •  •  •  +  dln^n  = 

+  U22^2  +  •  •  •  +  0>2nXn  —  ^2 


^mlXi  “h  ^m2^2  “1“  *  *  '  “b  ^mn^n  — 

this  system  can  be  written  in  the  matrix  equation  form: 

Ax  =  h, 

where  A  is  the  matrix  of  coefficients  ,  x  is  the  vector  of  variables  and  b  is  the  vector  of 
right-hand  side  constants.  Multiplying  Ax  we  get  the  result  b.  Therefore,  a  system  of  linear 
equations  can  be  replaced  by  the  matrix  equation: 


67 


Ax  = 

ail  <^12  • 

021  0-22  • 

^In 

■  Xi  ■ 

X2 

61  1 
b2 

=  b 

.  O^fil  Ojji2 

^mn  - 

.  . 

-  - 

If  we  think  of  the  matrix  ^  as  a  matrix  consisting  of  a  row  of  column  vectors,  this  system 
of  linear  equations  can  also  be  written  in  the  vector  equation  form: 


XjCi  +  X2CI2  +  •  •  •  +  Xn3n  =  b. 


In  the  vector  equation  Xi  is  the  ith  component  of  the  vector  x  of  variables,  where  i  = 
1, 2, n.  The  term  is  the  ith  column  vector  of  the  matrix  of  coefficients  A  above,  where 
*  =  1, 2, n.  6  is  the  vector  of  right  hand  side  constants.  Given  the  matrix  equation: 


[  Ol  ^2 


3n  ] 


■  Xi  ' 

bi  1 

X2 

b2 

.  Xn  . 

-  _ 

we  can  obtain  the  vector  equation: 


On 

0-21 

+  ^2 

<*^12 

O22 

+  • 

•  +  Xn 

0\n 

02n 

61  1 
^2 

.  Ofni  _ 

.  0^2  _ 

.  Offin  . 

,  bm  _ 

which  can  be  written: 


a;iai  +  X2a2  H - h  =  b. 

So  we  can  view  the  linear  system  in  three  distinct  ways: 


(in.2) 


1 .  a  system  of  linear  equations, 

2.  a  matrix  equation,  and 

3.  a  vector  equation. 
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This  means  the  system  of  linear  equations  has  the  same  solution  set  as  the  matrix 
equation,  which  also  has  the  same  solution  set  as  the  vector  equation. 

Example  3.1  Given  the  system  of  linear  equations: 

—2xi  +  3x2  +  4x3  =  ■  2 

Xj  +  2X2  =  1  , 

—  2x2  —  ~3 

the  matrix  equation  is: 


and  the  vector  equation  is: 


B.  LINEAR  COMBINATIONS  OF  VECTORS 

Given  A:  nx  1  vectors  ViV2,  •  •  •,Vk  and  k  scalars  ci,  C2, Cj.,  a  linear  combination 
is  a  sum  of  the  form 

ciVi  +  C2V2  H - h  CkVk  =  y, 

where  the  Cj  are  scalars  of  the  vectors  Vi.  Notice,  this  is  a  vector  equation.  Referring  to  the 
vector  equation  form  of  our  system  of  linear  equations  (///.2),  we  see  that  b  is  written  as  a 
linear  combination  of  the  column  vectors  with  scalars  Xj. 

Example  3.2  Let  u,  v,  w,  zbe  vectors  in  such  that: 

4u  +  2v  =  —w  +  z. 

Express  u  as  a  linear  combination  of  u,  w,  and  z. 

Solution: 

^  3 

—2v  —  w  z  =  4u 

—v  —  -w  +  -z  —  u. 

2  4  4 

w  is  a  linear  combination  of  v,  w,  and  z  with  scalars  and 
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If  u,v,w,z  are  vectors  in  R",  then  the  span  of  {u,  v,w,^  ,  denoted  Span{ri,  v,w,^, 
is  the  set  of  all  possible  linear  combinations  of  u,v,w,z.  We  say  a  vector  x  is  in  Span{«,  v,  w,  z} 
if,  and  only  if,  x  can  be  written  as  a  linear  combination  of  the  vectors  u,  v,  w,  and  z\ 

X  —  C\U  +  C2V  +  C^W  +  CiZ.  an3) 

If  the  system  ni.3  is  inconsistent,  then  x  is  not  in  Span{{t,  v,  w,  z} . 

It  may  be  easier  to  understand  the  span  if  we  can  visualize  it.  If  u  is  a  nonzero  vector 
in  R^,  then  Span{u}  is  the  set  of  all  multiples  of  v,  a  line  in  R^,  see  figure  10.  Similarly,  if 


Figure  10.  Span  of  a  \fector 

u  and  V  are  nonzero  vectors  in  R^,  and  v  is  not  a  multiple  of  u,  then  Span  {u,  v}  is  the  set 
of  linear  combinations  of  u  and  v,  a  plane  in  R^,  see  figure  11 


Example  3.3 


Let  ai  = 


Show  that  b  is  in  the  plane  spanned  by  Uj  and  02- 

Solution: 

We  must  show  that  b  can  be  written  as  a  linear  combination  of  the  vectors  a-i  and  a^  : 


Cldi  +  C2C12  — 
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Figure  11.  Span  of  Two  \fectors 
Now  solve  the  linear  system  for  scalars  Ci  and  C2 


2  ■ 

3  ■ 

0  ■ 

Cl 

1 

-1 

+  C2 

2 

-4 

— 

1 

-5 

Using  vector-scalar  multiplication,  we  obtain: 


2ci 

3c2 

0  ■ 

Cl 

+ 

2C2 

= 

1 

.  . 

(M 

1 

_ 1 

-5 

Using  vector  addition,  we  obtain; 


2ci 

+ 

3c2 

0  ■ 

Cl 

-F 

2C2 

1 

-  -Ici 

+ 

1 

O 

1 

-5 

We  know  two  vectors  are  equivalent  if  they  have  identical  components,  so  we  set  the  com¬ 
ponents  in  the  left  side  vector  equal  to  the  components  in  the  right  side  vector: 

2ci  -1-  3c2  =  0 

Cl  -|-  2c2  =  1 

— Cl  -F  — 4c2  =  — 5. 


71 


Solve  the  system  of  linear  equations  for  Ci  and  C2: 


Augmented  matrix 


2 

3 

0  ■ 

■  2 

3 

0  ■ 

1 

2 

1 

row  equivalent  to 

0 

1 

2 

-1 

-4 

-5 

0 

0 

0 

The  unique  solution  is  Cj  =  3,  C2  =  —2.  Since  the  linear  system  is  consistent,  6  is  a 
linear  combination  of  the  vectors  ai  and  02  with  scalars  ci  =  3  and  C2  =  -2,  and  b  is  in 

Span{ai, 02} • 


C.  LINEAR  INDEPENDENCE  OF  VECTORS: 

The  vectors  u,v,w,z  are  linearly  independent  if  the  only  solution  to  the  homoge¬ 
neous  vector  equation 

CiU  -b  C2V  -b  CzW  +  CjZ  =  0, 

is  the  trivial  solution.  The  vectors  u,v,w,z  are  linearly  dependent  if  they  are  not  linearly 
independent,  in  other  words  the  vector  equation 

ciu  -I-  C2V  -f  C3W  -f  C4Z  =  0 

has  nontrivial  solutions.  This  means  at  least  one  Cj  is  nonzero.  Some  additional  guidelines 
to  determine  linear  dependence  are  ; 

1.  Griven  a  set  of  vectors  in  R^,  if  the  number  of  vectors  is  greater  than  the 
number  of  components  in  the  vectors,  then  the  set  of  vectors  is  linearly  dependent. 
This  statement  is  only  intended  to  be  applied  to  a  set  of  vectors,  not  a  system  of 
linear  equations. 

2.  If  the  zero  vector,  0,  is  in  a  given  set  of  vectors,  then  the  set  of  vectors  is 
linearly  dependent. 


Example  3.4  The  following  vectors  are  linearly  dependent: 


1 

3 

2 


4  vectors  each  with  only  3  entries 
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Example  3.5  The  following  vectors  are  linearly  dependent; 


1 

CO 

1 _ 

0 

1 _ 

1 _ 

1 

1— ■ 

0 

5 

1 

1  I 

0 

- 1 

CO 

1 

_ 1 

The  zero  vector  is  a  member  of  this  set 


Example  3.6 

dent; 


Solution: 


Determine  whether  x,  y,  and  z  are  linearly  dependent  or  linearly  indepen- 


■  1  ■ 

■  1  ■ 

■  1  ■ 

X  ~ 

1 

1 

,  y  = 

1 

0 

0 

0 

Start  by  solving  the  homogeneous  equation; 

cix  +  c^y  +  csz  =  0. 

This  gives  us 


■  1  ■ 

■  1  ■ 

■  1  ■ 

'  0  ■ 

Cl 

1 

+  C2 

1 

+  C3 

0 

0 

1 

0 

0 

0 

Using  vector  scalar  multiplication  we  obtain 

Cl  ' 

C2 

C3 

■  0  ■ 

Cl 

+ 

C2 

+ 

0 

— 

0 

.  '^1  . 

0 

0 

0 

Using  vector  addition  gives  us 


Cl 

+ 

C2 

+ 

C3 

■  0  ■ 

Cl 

+ 

C2 

+ 

0 

— 

0 

. 

+ 

0 

+ 

0 

0 

Setting  the  entries  of  the  two  vectors  equal,  we  get  the  linear  system 


Cl  +  C2  +  C3  =  0 

Cl  +  C2  =  0 

Cl  =  0, 

which  has  only  the  trivial  solution  ci  =  C2  =  C3  =  0.  Therefore,  the  vectors  are  linearly  in¬ 
dependent. 


Example  3.7  Determine  whether  the  following  vectors  are  linearly  dependent  or  linearly 


73 


independent: 


Vi  = 

1 

-1 

11 

-2 

-4 

II 

1 

1 

l—l 

CO 

_ 1 

2 

2 

.  17 

Solution: 

Solve  the  homogeneous  system  of  linear  equations: 


1 

-2 

4 

0  ■ 

■  1 

-2 

4 

0  ■ 

-1 

-4  -13 

0 

row  equivalent  to 

0 

-6 

-9 

0 

2 

2 

17 

0 

0 

0 

0 

0 

Xi  and  X2  are  pivot  variables  and  xs  is  a  free  variable.  Therefore,  the  linear  system  has 
nontrivial  solutions  and  the  three  vectors  are  linearly  dependent. 

The  rank  of  a  matrix  is  the  number  of  linearly  independent  rows  or  columns  in  the 
matrix.  We  can  use  what  we  have  learned  about  linear  independence  to  determine  the  rank 
of  a  matrix.  To  determine  the  rank  of  a  matrix,  use  Gaussian  elimination  to  reduce  a  matrix 
to  row  echelon  form.  The  nonzero  rows  are  linearly  independent.  Additionally,  the  columns 
with  pivots  are  linearly  independent. 


‘1-2  1  4  -1  ■ 

"1-2  1  4  -1  ■ 

Example  3.8  Let  A  = 

4-8-6  4  -2 

1  -2  16  -10  -1 

row  equivalent  to 

rsj 

0  0  10  12  -2 

0  0  0  32  -3 

3  -6  18  -2  -3 

0  0  0  0  0 

The  rank  of  A  =  3.  The  first  three  rows  of  A  are  linearly  independent,  the  first,  third,  and 

fourth  columns  (columns  with  pivots  underlined)  are  linearly  independent.  Notice,  there  is 
only  one  linearly  dependent  row  vector,  the  fourth  row;  but,  there  are  two  linearly  dependent 
column  vectors,  the  second  and  the  fifth  columns. 

The  number  of  linearly  independent  rows  is  equal  to  the  number  of  linearly  inde¬ 
pendent  columns  in  a  matrix.  The  same  is  not  necessarily  true  for  linearly  dependent  rows 
and  columns. 


D.  LINEAR  TRANSFORMATIONS 

I 

In  this  section  we  will  study  vector-valued  functions  of  the  form  ' 


T  {x)  =  y, 
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where  T  takes  a  vector  x  in  and  changes  it  into  a  vector  yinR'^.  We  say  that: 


T:R^-^R^ 

is  a  transformation  from  i?”  to  i?”*,  with  a  rule  T,  which  assigns  to  each  independent  vector 
variable  x  in  the  domain  RP-,  one  and  only  one  dependent  vector  variable  yinlT-.T  (x) 
is  the  image  of  x  under  the  transformation  T.  The  range  of  T  is  the  set  of  all  images  T  (x) 
in  R^.  Let’s  look  at  an  example. 


Example  3.9  Define  a  transformation  T  :  R"^  ^  R^hy  the  rule  T 

When  f  ^  1  . 


Xi 

Xl 


Ixx 

X2 


T{x)^y 


( 

■  aji  ■ 

V 

2xi 

\ 

_  X2 

) 

X2 

We  are  concerned  with  transformations  from  i?"  to  RR  which  are  associated  with 
matrices,  called  matrix  transformations.  Griven  an  m  x  n  matrix  A.  and  a  column  vector  x  in 
i?" ,  the  product  is  an  m  x  1  column  vector  bmRR.  We  say  f  in  i?”  is  transformed  to  6  in 
i?"*  by  the  matrix  A.  Using  matrix  notation,  we  can  define  the  transformation  T  :  RP'  R^ 
by  the  notation: 

T  (x)  =  Ax,  where  Ax  =  b. 

We  are  used  to  working  with  the  equation  Ax  =  b,  so  we  have  been  working  with  matrix 
transformations  every  time  we  found  a  vector  x  for  which  the  linear  system  Ax  =  b  was 
consistent.  The  next  example  focuses  on  the  rule,  image  and  range  of  a  transformation. 
[Ref  4] 


'2  4  ■ 

o' 

2  ■ 

■  4  ' 

Example  3.10  Let  A  = 

-1  -2 

3  6 

,  u  = 

~6 

1 

,  b  = 

-1 

3 

6 

5 
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a)  Define  the  rule  for  the  transformation  T  :  by  T  (x)  =  Ax.  This  gives  us: 

T  (x)  —  Ax 

Xi  ' 

X2  _ 

2xi  +  4x2 

=  —  la;i  —  2x2 

3xi T  6x2 

This  is  the  rule  T  for  the  transformation. 

b)  Find  T  {u) ,  the  image  of  u  under  T. 

Solution; 

T  [u)  =  Au 

-3  ■ 

1 


-2 

=  1 
_  -3 

c)  Find  X  in  R?,  whose  image  under  T  is  6.  In  other  words,  solve  the  transformation  T  (x)  = 
b,  for  X.  This  is  a  linear  system  Ax  =  b,  which  we  can  already  solve: 

Solution: 


2  4 
-1  -2 

3  6 


2  4 
-1  -2 

3  6 


Ax  =  b 


— 1 

to 

2  ■ 

-1  -2 

Xi 

— 

-1 

1 - 

CO 

X2 

3 

This  is  the  matrix  equation  for  a  system  of  linear  equations.  We  can  solve  this  system  by 
reducing  the  augmented  matrix. 


2 

4 

2  ■ 

■  2 

4 

2  ■ 

-1 

-2 

-1 

row  equivalent  to 

0 

0 

0 

3 

6 

3 

0 

0 

0 

76 


This  gives  us  the  solution 


rci  ■ 

-2X2  +  1 

X2 

X2 

d)  Is  there  more  than  one  x  whose  image  under  T  is  hi 

%s,  X2  is^n  independent  variable.  There  are  infinitely  many  vectors  whose  images  un¬ 
der  T  are  b. 


e)  Is  c  in  the  range  of  the  transformation  T  ?  Recall,  the  range  of  T  is  the  set  of  all  images 
under  T,  so  we  need  to  determine  if  c  is  the  image  for  some  x  in  Again  we  will  be  solv¬ 
ing  a  linear  system: 


Solution: 


Reduce  the  augmented  matrix: 


T{x) 

Ax 


c 

c 


to 

r 

■  4  ■ 

-1  -2 

— 

6 

3  6 

X2 

5 

2 

4 

4  ■ 

■  2 

4 

4  ■ 

-1 

-2 

6 

row  equivalent  to 

0 

0 

8 

3 

6 

5 

0 

0 

-1 

This  system  is  inconsistent;  therefore,  c  is  not  an  image  for  any  x  in  and  c  is  not  in  the 
range  of  T. 


Example  3.11  Given  A  = 
formation? 


1  2 
-2  0 
3  -1 


,ifT  :  ^  what  is  the  rule  T  for  the  trans- 


Solution: 

Since  T  (x)  =  Ax,  the  rule  is: 

Rule 

Xi  -j-  "1X2 

2xi 

3a;i  —  X2 

vector  in 

We  should  see  a  relationship  between  matrix  transformations  and  our  study  of  the 


■  1  2  ■ 

_ 

“ 

-2  0 

Xi 

_ 

3  -1 

-  ^2  _ 

vector  in  L 
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linear  system  Ax  —  b.  In  solving  the  system  of  equations  Ax  =  b,  we  have  been  finding 
all  vectors  x  in  i?”,  which  are  transformed  into  the  vector  b  in  under  the  “action” 
of  multiplication  by  A.  It  turns  out  that  given  a  transformation  T  (x)  —  Ax,  this  matrix 
transformation  T  :  HP’  is  a  linear  transformation  if: 

1 .  T{u  +  v)  =  T{u)  -\-  T{v)  for  all  vectors  u  and  v  in  the  domain  of  the  trans¬ 
formation  T. 

2.  T{cu)  =  cT{u)  for  all  u  and  all  scalars  c 

These  two  rules  state  that  vector  addition  and  scalar  multiplication  are  preserved 
when  a  transformation  is  linear. 


If  a  transformation  satisfies  both  rules  for  all  u  and  v  in  the  domain  of  T  and  all 
scalars  c  and  d,  then  the  transformation  must  be  linear.  These  rules  can  be  generalized  for 
more  than  two  vectors: 


T{ciVi  +C2V2  +  ---  +  CpVp)  =  CiT{vi)  +  C2T{v2)  +  ■■■  +  CpT{Vp). 


This  is  called  the  superposition  principle  in  engineering  and  physics 


Example  3.12 


y 


2xi 

X2 


Determine  if  T  {x)  =  y  is  a  linear  transformation  when  x  = 


X2 


and 


Solution: 

A  transfonnation  is  linear  if  the  following  mles  hold 


1.  T{u  +  v)  =  T(u)  +  T(v)  for  all  vectors  u,  V  in  the  domain  of  T. 

2.  T{cu)  =  cTlu)  for  all  vectors  u  in  the  domain  of  T  and  all  scalars  c.Let 

r  .  1  r  n 


u  = 


Ui 

U2 


Vi 

^2 


.  Then: 


,  and  V  = 

L  ^^2  j 
T{u  +  v)  =  T  ^ 


Ui  -|-r;i 

U2  +  V2 


I) 
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_  2  {ui  +  uj) 

'^2  + 

_  ^Ui  -)-  2'i)j 

U2  +  V2 

_  2ui  ^  2vi 

^2  J  [  ^2 

=  T{u)+T{v). 

The  first  rule  holds,  but  that  is  not  enough.  Both  rules  must  hold!  Check  the  second 
rule.  Let  c  be  a  scalar: 


=  cT{u). 

The  second  rule  holds.  Since  both  rules  hold,  the  transformation  is  linear. 

Let’s  think  about  this  a  second:  in  order  to  show  that  a  transformation  is  linear,  you 
must  show  that  both  vector  addition  and  scalar  multiplication  are  preserved.  If  one  of  the 
rules  fails,  you  can  conclude  that  the  transformation  is  not  linear  without  checking  the  other 
rule.  Why?  Because  even  if  the  second  rule  holds,  the  first  rule  already  failed. 

Let’s  look  at  a  few  more  examples  of  linear  transformations. 


Example  3.13  Griven  an  angle  9  and  a  matrix  A  =  .  „  ^  the  transformation 

sin  o  cos  U 

^  ^  B?,  defined  by  the  mle  T  (x)  =  Ax,  rotates  the  directed  line  segment  associated 

with  the  vector  x  counterclockwise  through  the  angle  9. 


Let  9  =  90°  and  let  x  = 


then: 


T  (x)  =  Ax 

cos  90°  —sin  90°  1 

sin  90°  cos  90°  1 
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-1 

1 


If  you  plot  the  directed  line  segments  associated  with  the  vectors  x  and  Ax,  you  will  see 
that  Ax  is  the  result  of  rotating  the  x  counterclockwise  by  90°. 


Let  6  =  j  and  let  x  = 


1 

0 


then: 


cos  I  - 
sin  I 


T  {x)  —  Ax 


sin  I 
cos  I 


1 

0 

1 

0 


2 


Again,  if  you  plot  the  directed  line  segments  associated  with  the  vectors  x  and  Ax,  you  will 
see  that  Ax  is  the  result  of  rotating  x  counterclockwise  through  the  angle 


In  the  above  example  the  linear  transformation  rotates  a  point  in  about  the  origin, 

through  the  angle  9.  This  linear  transformation  is  called  a  rotation . 


Example  3.14  We  can  define  a  transformation  T  :  i?”  — >  i?”  by  the  rule  T  (x)  =  rx, 

~  1  " 


where  r  is  a  scalar.  Let  x  = 


and  let  r  =  I : 


T  (x)  =  rx 


1/2 

1/2 

1/2 


The  resulting  directed  line  segment  associated  with  the  vector  is  shorter  than  the  original 
associated  directed  line  segment. 
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Using  the  same  let  r  ==  3: 


T  (x)  =  rx 


This  time  the  resulting  directed  line  segment  associated  with  the  vector  is  longer  than  the 
original  associated  directed  line  segment. 

When  0  <  |r|  <  1,  the  transformation  T  compresses  the  directed  line  segment  associ¬ 
ated  with  the  vector  x  into  a  shorter  directed  line  segment  by  a  factor  of  r;  this  is  called  a 
contraction.  When  |r|  >  1,  the  transformation  T  stretches  the  associated  directed  line  seg¬ 
ment  into  a  longer  directed  line  segment  by  a  factor  of  r;  this  is  called  a  dilation.  If  r  <  0, 
the  associated  directed  line  segment  is  also  pointed  in  the  opposite  direction.  Can  you  re¬ 
late  this  transformation  to  a  matrix  transformation?  What  matrix  would  you  use  to  define 

r  0  0 

the  transformation  T  (x)  =  Ar  and  get  the  same  result  as  T  (x)  =  r^?  Try  0  r  0 

0  0  r 


Let  r  =  3,x  = 


T  {x)  =  Ax 
r  0  0 

=  0  r  0  X 

0  0  r 

'  3  0  0  1  r  1 
0  3  0  1 

0  0  3  J  [  1 


This  is  the  same  result  as  the  transformation  T  (x)  =  rx.  If  you  check  to  see  whether  the 
operations  of  vector  addition  and  scalar  multiplication  are  preserved,  you  will  find  that  this 
is  also  a  linear  transformation.  One  final  example: 


Example  3.15  If  we  have  a  line  I  which  passes  through  the  origin,  we  can  define  a  trans- 
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formation  T  (x)  —  Ax  which  reflects  each  point  in  the  plane  across  the  line  1.  This  trans¬ 
formation  is  called  a  reflection. 


Let  I  be  the  y-axis.  The  standard  matrix  for  reflection  across  the  y-axis  is  A  = 

,  then  the  transformation  T  :  B?  ^ 

T  (x)  =  Ax 

^■-10 
0  1 
■  -2  ■ 

3 

If  you  plot  the  directed  line  segment  associated  with  the  vectors  x  and  Ax,  you  will  see 
that  the  new  directed  line  segment  is  the  mirror  image  of  the  original  directed  line  segment 
across  the  y-axis. 


2 

3 


Let  X  = 


2 

3 


How  about  a  reflection  across  the  a;-axis?  The  standard  matrix  for  reflection  about  the 
x-axis  is  A  =  [  Q  .  Using  the  same  vector  x,  the  transformation  T  :  is: 


T{x) 


2 

3 


Plot  the  associated  directed  line  segments  to  see  the  reflection. 

Let’s  try  one  more  reflection:  Across  the  line  x  =  y.  The  standard  matrix  for  re- 

.  Using  the  same  vector  x,  the  transformation 

T:R^-^R?  is: 


flection  about  the  line  a;  =  y  is  A  = 


0  1 
1  0 


T  (x)  =  Ax 


Plot  the  directed  line  segments  to  see  the  re: 


0  1  2 

1  0  3 

3  ■ 

2 

Section  across  the  line  x  —  y. 


E.  EXERCISES 
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l.^Write  the  following  systems  of  linear  equations  in  matrix  equation  form 
Ax  =  b. 


3a:i  +  X2  -  4xs  =  0  ' 

a)  2iXi  —  3iC2  "1"  3iC3  =  — 2 

Xi  +  2^2  —  x^  =  2 

4x2  —  xz  +  2x4,  =  5 

b)  2xi  +  X2  A  3xz  =  6 

4xi  —  X2  A  2xz  —  3x4  —  2 

2.  Write  the  matrix  equation  as  a  vector  equation. 


3.  Write  a  system  of  equations  which  is  equivalent  to  the  given  vector  equation. 


4.  Write  a  vector  equation  which  is  equivalent  to  the  given  system  of  equations. 

23^1  A  X2  A  3x3  =  6 

Xi  +  2X2  -  X3  =  2 

3X2  +  X3  =  4 

5.  Write  the  following  system  of  linear  equations  as  a  matrix  equation  and  as  a 
vector  equation. 

Xj  ~|“  X2  2x3  4“  X4  =  1 

— Xi  —  2X2  "h  3X3  ~  X4  =  — 1 

2xi  —  X2  +  6x3  —  3:4  =  4 

6.  Let  u,  V,  w,  X  be  vectors  in  such  that  -4  (x  -  «)  =  5  (u  -  3w) .  Express 
X  as  a  linear  combination  of  u,  v,  and  w. 


7.  Determine  if  6  is  a  linear  combination  of  the  columns  of  the  matrix  A. 
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8.  Do  {viV2,v:i}  span 


- 1 

1 

_ 1 

■  -1  ■ 
0 

- 1 

0 

_ 1 

0 

II 

1 

II 

CO 

0 

1 

0 

1 

0 

_ 1 

1 

1 

1—^ 

i _ 

9.  Given  x  and  A  below,  is  x  in  the  plane  spanned  by  the  columns  of  A? 


X  = 

■  -5  ■ 
-3 

,  A  = 

2  -1  ■ 
4  5 

4 

1 

CO 

1 

to 

10.  Determine  if  b  is  in  the  Span{ai,  02,03} . 


11.  This  exercise  compares  a  set  of  vectors  with  the  span  of  a  set  of  vectors 

1“  _  .  _  “1  r-  * 


[Ref  4]  Let  A  = 

^  oi,  02,  and  03  and 


2-1  3 

—5  3  —1  I  and  6 

_  6  -2  4 

etVF  =Span{oi,  02,03}. 


1 

8 

6 


Denote  the  columns  of  A  by 


a)  How  many  vectors  are  in  {oi,  02, 03}? 

b)  Is  6  in  {01,02,03}? 

c)  Is  6  in  W1 

d)  How  many  vectors  are  in  PF? 
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e)  Show  that  ai  is  in  W.  (Hint:  row  operations  are  not  necessary). 


12.  Given  x  = 

4  ■ 

0 

,y  = 

■  -1  ■ 
3 

,a  = 

5  ■ 
-1 

,b  = 

9 

-3 

-2 

5 

2 

-9 

a)  Is  a  GSpan(;r,  y)l 

b)  Is  h  GSpan(x,  y)? 


13.  Let 


A  = 


a)  Determine  the  rank  of  A. 


1  2  0 

3  7-5 

4  8  5 


b)  Given  x  = 


-1 

8 

-14 


,  is  :r  in  the  plane  spanned  by  the  columns  of  .4? 


14.  Solve  the  equation  Ax  =  b  with  A  and  b  given  below.  Write  the  solution  as 
a  vector. 


A  = 

'7  -2  -5 ■ 
3  4  1 

,  b  = 

-6  ■ 
-14 

0-6  2 

20 

15.  Let  T  (x)  =  Ax.  Define  the  rule  for  the  transformation.  (Compute  Ax). 


4 

-2 

5  ■ 

&)A  = 

-1 

3 

8 

X  = 

2 

1 

-2 

1  ■ 

h)A  = 

-3 

X  = 

r 

2 

s 

■  0  0 

1  ■ 

r 

c)A  = 

1  0 

0 

,  X  = 

$ 

0  1 

0 

t 

Xi 

^2 

xz 
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16.  ForA= 


2  0 
0  2 


define  T  :  E? 


B?  by  T{x)  =  Ax. 


Find  the  images  under  T  of  u  = 


2 

3 


and  V  = 


-1 

-3 


17.  Define  T(:f)  =  Ax,  find  an  X  whose  image  under  T  is  b.  Determine  if  x  is 
unique. 


A  = 

■  3 

1 

-5 

2 

-1  ■ 
1 

,  b  = 

■  -7  ■ 
14 

4 

0 

2 

24 

18.  Find  all  :f  in  that  are  mapped  into  the  zero  vector  by  the  transformation 
T{x)  =  Ae  where 


A  = 


7  0  3  1 

-51-3  3 

6  0  4  -2 


19.  a)  Let  A  be  a  4  x  6  matrix.  What  values  must  a  and  b  have  to  define  a  trans¬ 
formation  T  :  E^by  T(x)  =  Ax. 

b)  Let  A  be  a  5  X  3  matrix.  What  values  must  a  and  b  have  to  define  a  transformation 
T:E‘^^E’’by  T(x)  =  Ax. 

c)  Let  A  be  a  4  X  4  matrix.  What  values  must  a  and  b  have  to  define  a  transformation 

r  :  i7“  i?*’  by  T(x)  =  Ax. 


7 

0 

3 

1  ■ 

and  b  = 

19 

20.  Let  A  = 

-5 

1 

-3 

3 

-10 

6 

0 

4 

-2 

12 

imm 

linear  transformation  T(:e)  =  Ax? 


Is  b  in  the  range  of  the 
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21.  Use  a  rectangular  coordinate  system  to  plot 
images  under  the  transformation  T.  State  what  type  o: 

T(x)  = 


and 


-4 

-1 


and  their 


linear  transformation  T  is. 


1 

o 

lO 

o 

1 

1 _ 

Xi  ' 

L  0  -0.5 

.  ^2  . 

and 


,  and  their 


22.  Use  a  rectangular  coordinate  system  to  plot 
images  under  the  transformation  T.  State  what  type  of  linear  transformation  T  is. 


-4 

-1 


T(x)  = 


1 

rH 

o 

Xi  ' 

[  1  0 

X2 

23.  Let  A  = 


r  =  2. 


a)  Define  T{x)  =  Ax. 

b)  Compute  T(u  +  v)  and  T{u)  +  T{v). 

c)  Compute  T  {ru)  and  rT  (u) . 

d)  Is  the  transformation  defined  by  T  (x)  =  Ax  linear? 


24.  Suppose  x4  is  an  m  X  n  matrix,  and  its  transformation  T  :  is 

defined  by  T  {x)  =  Ax.  Find  the  rule  of  the  transformation  T(x)  and  give  the  domain 


and  range  of  T(^).  For  example,  if  A  = 


2  -2 
-1  0 

3  1 


then  the  rule  is: 


T  (x)  =  Ax  = 


2  -2 
-1  0 

3  1 


Xi 

X2 


2xi  —  2x2 

-Xi 

3X1  X2 
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and  the  domain  and  range  are  B?  and  B?,  respectively. 

2  1 


a)  Find  the  rule,  domain  and  range  for  A  = 


-1  3 
1  -1 
0  ■  4 


b)  Find  the  rule,  domain  and  range  for  A  =  [  3  —2  4  1  ] 


25.  Determine  if  T  is  a  linear  transformation.  Give  the  domain  and  range  of  T 
and  if  r  is  linear,  find  A  such  that  T{x)  =  A£ 


2x  +  2y 
X  —  2y  -ir  Zz 


26.  For  both  transformations  below; 


X 

x] 

.  y . 

)- 

- 1 

CN 

_  1 

X 

y 

)=l 

z 

/  L 

a)  Determine  whether  or  not  T  is  a  linear  transformation. 

b)  Give  the  domain  and  range  of  T. 

c)  For  both  transformations  calculate  T{x)  when  x'= 

d)  If  T  is  linear,  find  A  such  that  T{x)  =  Ax. 

e)  If  T  is  linear,  use  A  to  find  T{x)  when  x  =  ^ 


4 

1 


/ 

r  -j 

\ 

Xi 

r  1 

\ 

Xi 

^2  _ 

2Xi+X2 

r( 

Xi 

^2 

2 

\ 

/ 

^2 

/ 

.  ^2  . 
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IV  MATRIX  AJLGEBRA 


This  chapter  begins  with  the  introduction  of  two  new  types  of  matrices,  the  iden¬ 
tity  matrix  and  elementary  matrices.  These  matrices  are  essential  in  the  development  of  the 
inverse  of  a  matrix  and  matrix  factorization.  Next  we  learn  two  new  methods  for  solving 
linear  systems  using  inverses  and  LU  decomposition.  The  chapter  finishes  with  an  intro¬ 
duction  to  the  determinant  of  a  matrix  and  another  method  for  finding  the  solution  to  a  linear 
system  known  as  Cramer’s  rule. 


A.  ELEMENTARY  MATRICES 


We  begin  our  study  of  elementary  matrices  by  defining  the  identity  matrix.  The 
identity  matrix  is  a  square  matrix  with  I’s  in  every  position  on  the  main  diagonal.  All  other 
entries  are  O’s.  An  identity  matrix  of  order  n  is  denoted 

The  following  matrices  are  examples  of  identity  matrices: 


ri 

0 

0  ■ 

II 

1 

o  o 

1 

0 

0 

1 

II 

1-? 

■  1 

0 

0  ■ 
1 

Given  an  m  x  n  matrix  A.  and  an  identity  matrix  of  appropriate  order,  we  have 


ImAmxn  —  Amxn  ^nd  Amxn^n  —  A^nxn- 


Thus,  when  we  multiply  the  matrix  A  on  either  side  by  the  identity  matrix,  the  result  is  the 
matrix  A.  For  this  reason,  the  identity  matrix  is  called  the  multiplicative  identity  for  the 
matrix  A. 


Example  4.1  Let  A  = 


1  2 
3  4 
5  6 


Then 


1A  = 


- 1 

o 

o 

■  1  2  ■ 

1 

to 

_ 1 

0  1  0 

3  4 

3  4 

1 

t-H 

o 

o 

_ 1 

5  6 

_  5  6  _ 

=  A 
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and 


AI 


"l  2 
3  4 
5  6 


1  0 
0  1 


1  2  ■ 

3  4  =  A 

5  6 


An  elementary  matrix  Ei  is  a  matrix  which  is  formed  by  performing  a  single  ele¬ 
mentary  row  operation  on  an  n  x  n  identity  matrix.  There  are  three  types  of  elementary 
matrices,  one  for  each  of  the  three  elementary  row  operations.  An  example  of  each  type 
follows. 


Example  4.2  Multiply  a  row  by  a  nonzero  constant; 

Multiply  row  2  by  3. 

■  1  0  0  ]  r  1  0  0  ■ 

010  ,  £11  =030  . 

_  0  0  1  J  [  0  0  1 

Example  4.3  Interchange  two  rows: 

Interchange  row  1  and  row  2. 

■  1  0  0  ]  r  0  1  0  ■ 

J=010,  E2=  100. 

0  0  1 J  [001 

Example  4.4  Add  a  multiple  of  one  row  to  another  row; 

Add  4  times  row  2  to  row  3 . 

'looi  rioo‘ 

1=010,  £;3=oio. 

_  0  0  1  J  [  0  4  1 

Theorem  4.1  Let  E  be  the  mx  m  elementary  matrix  formed  by  performing  a  single  ele¬ 
mentary  row  operation  eonanmxm  identity  matrix  1^-  Then 

E  =  e{lm)- 

Thus,  for  every  mxn  matrix  A,  the  elementary  row  operation  e  can  be  performed  on  A  by 
multiplying  A  on  the  left  by  the  corresponding  elementary  matrix 

e{A)  =  EA. 

Add  -2  times  row  1  to  row  2. 

■  1  2  3  -1  ]  r  1  0  0  ■ 

Example  4.5  Let  A=  2  0  —2  4  and  let  =  -2  10  .  Then 

_  4  1  7  5  J  L  0  0  1 
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100iri2  3-1]  ri  2  3-1' 

EA=  -2  1  0  2  0  -2  4  =  0  -4  -8  6. 

_00lJ[41  7  5  4  1  7  5 

Multiplying  the  matrix  A  by  the  matrix  E  adds  -2  times  row  1  of  the  matrix  A  to  row  2  of 
the  matrix  A. 


The  process  of  multiplying  a  matrix  by  an  elementary  matrix  can  be  repeated. 


■  1  2  3  -1  ■ 

Example  4.6  Let  A—  2  0  —2  4  , 

[4175]’ 

Add  -2  times  row  1  to  row  2.  Add  -4  times  row  1  to  row  3. 

*100]  fioo' 

El  =  —2  10  ,  and  E2=  0  10 

0  0  1  -4  0  1 

We  can  compute; 

’I00]ri2  3-1]  Tl 

EiA=  -2  1  0  2  0  -2  4  =  0 

_00lj4l7  5  4 


and 


100  1  2  3  -l]  fl  2  3-l' 

E2{EiA)  =  0  1  0  0  -4  -8  6  =  0  -4  -8  6  . 

-4  0  1  J  [  4  1  7  5  J  [  0  -7  -5  9 

Compare  the  results  of  multiplying  A  on  the  left  by  E^  and  E^  with  the  results  of  performing 
the  corresponding  row  operations  on  A  : 

■  1  2  3  -1  ]  r  1  2  3  -1  ]  [1 

2  0  -2  4  ~  0  -4  -8  6  ~  0 

.41  7  5j[4  1  7  5]  [o 

Add  -2  times  row  1  to  row  2.  Add  -4  times  row  1  to  row  3. 

A  nice  feature  of  elementary  row  operations  is  that  they  can  be  reversed. 


Example  4.7  Use  the  same  matrices: 

Add  -2  times  row  1  to  row  2. 

12  3-1]  flOO' 

A=  2  0  -2  4  and  Ei  =  -2  10  .  Then 

4175]  [001 
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EiA  = 


— , 

0 

0 

_ 1 

‘12  3  -1  ■ 

■  1  2  3  -1  ■ 

-2  1  0 

2  0-2  4 

= 

0-4-8  6 

0  0  1  _ 

4  17  5 

1 

1 

Reverse  the  operation  by  adding  2  times  row  1  to  row  2.  Let  E2  = 


1  0  0 
2  10 
0  0  1 


.  Then 


E2{E,A)  = 


1 

0 

0 

t-H 

1 _ 

■  1  2  3  -1  ■ 

'12  3  -1  ■ 

2  1  0 

0-4-8  6 

2  0-2  4 

1 - 

0 

0 

4  17  5 

4  17  5 

=  A 


The  result  of  the  multiplication  is  the  original  matrix  A. 


Let’s  think  about  what  this  means  for  elementary  matrices.  We  can  take  the  iden¬ 
tity  matrix  I  and  change  it  into  an  elementary  matrix  E  by  performing  an  elementary  row 
operation.  Then  we  can  take  that  elementary  matrix  E  and  change  it  back  into  the  identity 
matrix  I  by  performing  the  reverse  operation  on  E.  The  reverse  operations  are  [Ref  5]: 

Row  Operation  Reverse  Row  Operation 

1 .  Multiply  row  i  by  nonzero  constant  c.  1 .  Multiply  row  i  by  nonzero  constant  ^ . 

2.  Interchange  row  i  and  row  j.  2.  Interchange  row  i  and  row  j. 

3 .  Add  c  times  row  i  to  row  j.  3 .  Add  —  c  times  row  i  to  row  j. 


Let  Cl (/)  =  El,  an  elementary  matrix  formed  by  performing  a  row  operation  on  I 
Let  62(1)  =  E2,  the  elementary  matrix  formed  by  performing  the  corresponding 
reverse  row  operation  on  I. 


Then 


E2E1  =  1. 

Since  Ei  and  E2  perform  reverse  operations,  we  can  also  say 


E1E2  =  I. 


B.  INVERSE  OF  A  MATRIX 

In  this  section  we  will  study  the  inverse  of  a  matrix  and  the  concept  of  singular  and 
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nonsingular  matrices.  Additionally,  we  will  learn  how  to  compute  the  inverse  of  a  matrix. 
We  begin  with  the  multiplicative  inverse.  The  multiplicative  inverse  of  an  n  x  n  matrix  A 
is  a  matrix  B  such  that 

AB  =  BA  =  I. 

If  such  a  matrix  B  exists,  we  say  that  the  matrix  A  is  invertible  and  B  is  the  inverse  of  A, 
denoted  A~'^.  Then  the  above  equation  can  be  written 


AA  ^  =  A~'^A  =  I 


Example  4.8  Let  A  = 
Solution: 


2 

-1 


-5 

3 


AB  = 


AB  is  the  identity  matrix. 


5A=: 


and  B  = 


2  -5 

-1  3 


3  5 
1  2 


3 

1 


5 

2 


1  0 
0  1 


1  0 
0  1 


Compute  AB  and  BA. 


r  3  5  ■ 

[2-61 

1 

- 1 

CO 

T— 1 

1 

BA  is  also  the  identity  matrix.  Since  AB  =  I,  and  BA  =  /,  We  say  A  is  invertible  and  B 
is  the  inverse  of  A.  We  can  also  say  B  is  invertible  and  A  is  the  inverse  of  B. 


Only  square  matrices  will  have  inverses,  but  not  all  square  matrices  are  invertible. 


Example  4.9  Let  A 
Solution: 


1  0 
0  0 


and  B  = 


bi  62 
63  64 


Now  compute  AB. 


AB  = 

'10' 

[  ^>1  ^2  1 

0  0 

- j 

CO 

- i 

3 

bi  62 

0  0 

We  will  never  find  a  matrix  B  which  is  the  inverse  of  A,  because  no  matter  which  values 
are  in  the  matrix  B,  the  multiplication  AB  will  always  result  in  zeros  in  the  second  row. 
There  is  no  way  to  get  a  1  in  the  second  row,  second  column  position  (underlined  above). 
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The  matrix  A  does  not  have  an  inverse. 


Theorem  4.2  If  a  matrix  A  is  invertible,  its  inverse  is  unique. 

How  do  we  know  the  inverse  is  unique?  Suppose  the  inverse  is  not  unique.  Then 
the  matrix  A  has  two  distinct  inverses  B  and  C.  Since  B  and  C  are  inverses  of  A,  we  can 
conclude  that  AB  =  BA  =  I  and  AC  =  CA  =  I.  Substituting  into  the  equations  below, 

B  =  B1^  B{AC)  =  {BA)C  =  IC  C. 

We  see  from  these  calculations  that  B  =  C.  But,  we  started  out  saying  that  B  and  C  were 
distinct  inverses  of  A  and  came  to  a  contradiction  that  B  ^  C.  All  of  our  calculations  are 
accurate;  therefore,  our  assumption  that  B  and  C  are  distinct  must  be  incorrect.  Thus  the 
matrix  A  has  only  one  inverse. 

We  say  the  matrix  A  is  nonsingular  if  the  multiplicative  inverse  of  A  exists.  If 

no  multiplicative  inverse  of  A  exists,  then  A  is  singular.  In  our  previous  examples,  the 

2  —5 1  [35]  flOl 

matrices  2  ,  and  ^  2  ^^e  nonsingular  matrices  and  the  matrix  ^  ^  is 

singular. 

Three  useful  facts  about  invertible  matrices  are: 

1.  If  A  is  a  nonsingular  matrix,  then  A~^  is  also  a  nonsingular  matrix: 

(A-)-  =  A 

2.  If  A  and  B  a.ren  x  n  matrices  which  are  both  invertible,  then  the  product 
AB  is  also  invertible: 

iAB)~'^  ^  B-^A-\ 

We  can  generalize  this  fact.  The  product  ofknxn  invertible  matrices  is  invertible: 
(A1A2  ■■  ■  Ak)  ^  =  Al^  Al\  ■  ■  ■ 

3.  If  A  is  an  invertible  matrix,  then  A^  is  also  invertible  and 

(A-)-' ^  (A-'Y .  ^ 

By  now  you  are  probably  asking:  How  do  we  know  if  a  matrix  has  an  inverse  and 
how  do  we  find  the  inverse  of  a  matrix?  There  are  simple  formulas  for  the  inverse  of  1  x  1 
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and  2x2  matrices.  Given  a  1  x  1  matrix  A  —  [a],  then 


For  a  2  X  2  matrix,  the  formula  is  more  involved.  Let  A  — 
the  matrix  A  is  nonsingular  and 


o  6 
c  d 


.  If  ad  —  be  0,  then 


^-1  = 


1 

ad— be 


(IV4) 


If  ad-bc  =  0,  clearly  we  cannot  find  a  solution  for  and  the  matrix  A  is  singular/not 
invertible.  Let’s  look  at  our  invertible  matrices  above. 


Example  4.10  Given  the  matrix  A  = 


2  -5 
-1  3 


and  using  the  formula  in  equation  IV4, 


ad-bc=  {2-3)  -  (-5  •  -1) 
=  6-5 
=  1. 


Since  this  value  is  nonzero,  we  know  the  matrix  A  is  invertible  and 


d  -b 
—c  a 

1  r  3  5  ■ 

1  [  1  2  _  • 

■  3  5  1 
■  1  2  • 

This  is  the  inverse  of  the  matrix  A  Similarly,  we  could  start  with  the  matrix  A-\  apply  the 
formula  in  equation  IV4  and  the  result  would  be  the  matrix  A.  Try  this  yourself' 


ad  —  be 


What  if  our  matrix  is  larger  than  a  2  x  2  matrix?  We’ll  start  with  an  example  and 
follow  the  example  with  an  explanation. 


Example  4.11  Let  A  = 
ination  to  reduce  the  matrix 


4-2  6 

2  0-4 

2  0  2 


and  I  = 


1  0  0 
0  1  0 
0  0  1 


Use  Gauss-Jordan  elim- 


A  to  the  matrix  1.  Simul 


•  ml 

aneously  perform  the  same  row  oper- 
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ations  on  I  as  we  perform  on  A: 


'4-2  6  ■ 

■  1  0  0  ■ 

A  = 

2  0-4 

,  B  = 

0  1  0 

2  0  2 

1 

o 

o 

Add  -Y  times  row  1  to  row2  and  row  3: 


1 

1 _ 

O 

O 

T - i 

1 _ 

II 

t-H 

0  1  -7 

Bi  = 

-1/2  1  0 

_  0  1-1 

-1/2  0  1 

Add  —  1  times  row  2  to  row  3 : 


■  4 

-2 

6  ■ 

1 

0 

0  ■ 

A2  — 

0 

1 

-7 

,  B2  = 

-1/2 

1 

0 

0 

0 

6 

0 

-1 

1 

Multiply  row  3  by 


■  4 

-2 

_ 1 

1 

0 

1 - 

0 

A3  — 

0 

1 

-7 

,  ^3  = 

-1/2 

1 

0 

0 

0 

1 

0 

-1/6 

1/6  _ 

Add  7  times  row  3  to  row  2  and  add  —6  times  row  3  to  row  1 ; 


1 

to 

0 

1  1  -1  ■ 

A4  = 

0  10 

,  B4  = 

-1/2  -1/6  7/6 

0  0  1 

. 

0  -1/6  1/6 

Add  2  times  row  2  to  row  1 : 

0 

0 

0  2/3  8/6  ■ 

A5  — 

0  10 

)  B5  = 

-1/2  -1/6  7/6 

_  0  0  1  _ 

0  -1/6  1/6 

Multiply  row  1  by  | : 


'  1  0  0  ■ 

0  •  1/6  2/6  ■ 

0  10 

)  Be  = 

-1/2  -1/6  7/6 

0  0  1 

0  -1/6  1/6 

What  does  all  of  this  mean?  Using  elementary  matrices,  we  say  A  is  row  equivalent 
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to  In  if  there  exists  a  sequence  of  row  operations,  Ei,E2,  ...En,  such  that 


EnEn-l  ■  •  •  EiA  =  In- 

Since  the  product  of  invertible  matrices  is  invertible,  we  can  multiply  both  sides  of  the 
equation  by  the  inverse  of  the  product: 


{EnEn-i  ■  •  •  E^)-^{EnEn-^  •  •  •  Ei)A  =  {E^En-i  ■  ■  • 


This  gives  us 


InA={EnEn-i---E^)-^ln, 

which  is  simply 

A  =  {EnEn-l  ■  ■  ■  El)  \ 

This  means  that  A  is  the  inverse  of  the  matrix  E^E^-i  •  •  •  Ei,  in  other  words,  A  is  an 
invertible  matrix.  Therefore, 


A-' =  . 

which  simplifies  to 

A“^  -  {EnEn-i  ■  ■  ■  El). 

Thus 

A~^  =  {EnEn-l  -  •  •  Ei)ln, 

and  we  see  that  the  matrix  A  ^  is  the  result  of  performing  the  same  row  operations  on 
as  we  performed  on  the  matrix  A  when  we  transformed  A  to  This  is  the  idea  behind  the 
next  theorem. 

Theorem  4.3  An  n  x  n  matrix  A  is  nonsingular  if  and  only  if  A  can  he  reduced  to  the 
identity  matrix  with  a  sequence  of  row  operations.  The  sequence  of  elementary  row 
operations  which  reduces  the  matrix  A  to  the  matrix  also  transforms  the  identity  matrix 
In  into  A~^,  the  inverse  of  A 

The  next  example  refers  back  to  example  4.11, 


Example  4.12  When  we  perform  elementary  row  operations  on  A 


4-2  6 

2  0-4 

2  0  2 
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Using  Theorem  4.3,  we  can  develop  a  procedure  for  finding  A~^. 

1 .  Place  A  and  1  side  by  side  to  form  an  augmented  matrix 

[A  I] 

2.  Perform  row  operations  on  the  augmented  matrix  [A  I],  If  A  can  be  reduced 
to  I,  then  [A  I]  is  row  equivalent  to  [/  A~^]  and  we  can  read  A~^  off  of  the  aug¬ 
mented  matrix.  Otherwise,  A  does  not  have  an  inverse  and  we  say  A  is  singular. 


Here  is  another  example. 


1-1  o’ 

0  2-1  .FmdA-\ 

3-5  2 

"  1  -1  0  10  0’ 
[AI]=  0  2-1  0  10 

[3-5  2  0  0  1 

Add  —3  times  row  1  to  row  3: 


’  1 

-1 

0 

1 

0 

0 

_ .J 

0 

2 

-1 

0 

1 

0 

1 - 

0 

-2 

2 

-3 

0 

1 

Multiply  row  2  by 


’  1 

-1 

0 

1 

0 

0  ’ 

0 

1 

-1/2 

0 

1/2 

0 

0 

-2 

2 

-3 

0 

1 

Add  1  times  row  2  to  row  1  and  add  2  times  row  2  to  row  3. 


’  1 

0 

-1/2 

1 

1/2 

1 - 

0 

0 

1 

-1/2 

0 

1/2 

0 

1 - 

0 

0 

1 

-3 

1 

1 

Add  I  times  row  3  to  row  1  and  row  2. 

■  1  0  0  1/2  11/2’ 

0  1  0  -3/2  1  1/2  . 

001  -31  1 

We  have  transformed  A  into  1;  therefore,  our  theorem  tells  us  that  we  have  transformed  1 

r  1/2  1  1/2  ■ 

into  A~^.  Read  A~^  off  of  the  matrix,  A~^  =  -3/2  1  1/2  .  If  it  were  not  possible 

[-31  1 J 

to  transform  A  into  /,  then  we  would  conclude  that  A  is  singular. 


Computing  the  inverse  of  a  matrix  is  an  algebraically  expensive  operation  which 
can  lose  accuracy  quickly  when  using  a  computer  program.  However,  inverses  have  theo¬ 
retical  importance  which  will  be  useful  in  future  courses.  For  our  purposes,  when  we  have 
relatively  small  matrices,  we  can  use  the  inverse  to  solve  the  matrix  equation  Ax  =  b.  If  A 
is  an  invertible  matrix,  the  unique  solution  x  to  the  equation  Ax  =  bean  found  as  follows: 

Ax  =  b 


Example  4.13  Let  A  = 
Solution: 
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{A-^A)x  =  (A-^)6 
Ix  =  A-^b 
X  =  A~^b. 


Solving  linear  systems  is  almost  always  easier  and  faster  using  Gaussian  elimination  rather 
than  computing  an  inverse. 

Example  4.14  Solve  the  system  of  linear  equations  using  the  inverse. 

3a;i  +  Sx2  =  18 
Ixi  +  3x2  =  7 

Solution: 

Write  the  matrix  equation  Ax  =  b: 

3  8  rci  _  18 

1  3  a;2  7  ■ 

Find  A- 


A-^  = 


ad  —  be 


9-8 


d  -b 


3  -8 
-1  3 


Solve  the  equation  x  =  A  ^b- 


3  -8  1  r  18 


2  ,  a  unique  solution. 


C.  LU  DECOMPOSITION 


In  this  section  we  introduce  another  special  type  of  matrix,  the  triangular  matrix. 
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We  will  then  learn  how  to  solve  the  matrix  equation  Ax  =  hhy  factoring  the  matrix  A  into 
two  triangular  matrices. 

An  upper  triangular  matrix  is  an  n  x  n  matrix  in  which  all  entries  below  the  main 
diagonal  are  0  s.  The  entries  above  and  on  the  main  diagonal  may  or  may  not  be  O’s. 


A  = 


aji  ai2  ai3  au 

0  a22  Cl23  ^24 

0  0  a33  a34 

0  0  0  ^2-44 


is  an  upper  triangular  matrix. 


It  is  easy  to  show  that  the  product  of  two  upper  triangular  matrices  is  also  an  upper  triangular 
matrix,  as  suggested  by  the  following  example. 


Example  4.15  Let  A  — 


-2  4  3  6 
0  12  5 
0  0  7  0 
0  0  0  0 


and  B  = 


-104-2 
0  3  6  -5 
0  0  2  7 

0  0  0  5 


.  Then 


AB 


2  12  22  35 

0  3  10  34 

0  0  14  49 

0  0  0  0 


Similarly,  a  lower  triangular  maPix  is  an  n  x  n  matrix  in  which  all  entries  above 
the  main  diagonal  are  0  s.  The  entries  below  and  on  the  main  diagonal  may  or  may  not  be 
O’s. 

an  0  0  0 

(^21  a22  0  0 

^31  ®32  ®33  0 

^  a^l  042  043  O44  ^ 

The  product  of  two  lower  triangular  matrices  is  also  lower  triangular. 


is  a  lower  triangular  matrix. 


Example  4.16  A  = 

'  2  0  0  ' 
1  2  0 

and  5  = 

1 

0  0 

0  CO 

i— 1 

.  Then  AB  = 

'.8  0  0  * 
6  6  0 

CO 

CO 

1 

6  4  2 

10  24  6 

A  diagonal  matrix  is  an  nx  n  matrix  in  which  all  entries  above  and  below  the  main 


diagonal  are  zeros.  A  diagonal  matrix  is  both  upper  and  lower  triangular. 


A  = 


On  0  0 

0  022  0 

0  0  033 


is  a  diagonal  matrix. 
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Example  4.17  The  following  are  diagonal  matrices: 


■  1 

0 

1 

o 

1 

1 

o  c 

1 

o 

0 

o 

_ 1 

0 

3 

0 

1 

i 

0 

J 

0 

2 

0 

o 

- 1 

0 

1 

^  J 

0 

0 

0 

A  unit  triangular  matrix  is  an  n  x  n  triangular  matrix  with  only  I’s  on  the  main 
diagonal. 


Example  4.18  The  following  are  unit  triangular  matrices: 


o 

o 

■  1  0  0  ■ 

0  1  0 

6  10 

) 

0  0  1 

1  4  1 

14  6 
0  1  3 
0.0  1 
0  0  0 


8 

5 

0 

1 


Let’s  look  at  an  example  of  a  new  way  to  solve  a  system  of  linear  equations  using 
triangular  matrices. 


Example  4.19  Let  A  = 


2 

6 

-4 


-1  5 

-2  19 
6  4 


L 

different  triangular  matrices 

J 

■  1  0  0  ■ 

A=LU  = 

3  1  0 

-2  4  1 

L 

■  -2  ' 

Let  b  = 

1 

.  We  can  solve  the  equation, 

30 

.  Then  A  can  be  written  as  the  product  of  two 


2-1  5 

0  1  4 

0  0-2 


Ax  =  b, 

using  the  factorization 

A  =  LU. 

We  first  substitute  the  factorization  A  =  LU  in  Ax  =  b  to  get  the  new  equation: 


LUx  =  b. 


If  we  lety  =  U  x,  then  LU  x  =  b  becomes 

Ly  =  l 
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2/1 

y2 

2/3 


-2 

1 

30 


This  gives  us 

'  1  0  0 
3  10 
^  -2  4  1  __ 

Write  the  corresponding  linear  equations?*  T 
stitution : 

Vi  =  -2 

3yi  +2/2  =  1 

~2i/i  +  4i/2  +  2/3  =  30 

Substituting  in  yx  =  ~2  into  the  second  equation,  we  get 


hen  the  solutions  can  be  found  by  forward  sub- 


-6  +  y2  =  1 
2/2  =  7. 


Now  substitute  into  the  third  equation 


4 +  28  +  ^3  =  30 


2/3  = 


-2. 


The  solution  to  the  equation  Ly  =  bisy  = 

Ux  —  y 


-2 

7 

-2 


.  Now  use  y  to  solve  the  equation 


Xi 

X2 

Xs 


This  gives  us 

^2-1  5 

0  14 

^0  0  -2  ^  ^ 

Write  the  corresponding  linear  equations?*  Then  the  so 
substitution: 

2a:i  X2  +  Sx^  =  — 2 

X2  +  4x3  =  7 

-2x3  =  -2 

-2  ~ 


-2 
7 

-2  _ 

utions  can  be  found  by  backward 


This  will  yield  the  solution  x  = 


3 

1 


.  This  is  the  solution  to  the  matrix  equation  Ax  —  b. 


The  example  above  uses  matrix  factorization  of  the  matrix  A.  Matrix  factorization 
is  the'  process  of  decomposing  a  matrix  A  into  a  product  of  two  or  more  matrices.  We  use 
matrix  factorization  to  express  a  matrix  in  a  form  which  is  easier  to  use.  A  common  factor¬ 
ization  process  used  is  LU Decomposition  (Lower/Upper  triangular  matrix  decomposition). 
An  m  X  n  matrix  A  has  an  LU  factorization  if  it  can  be  written  in  the  form  A  =  LU,  where 
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L  is  an  m  X  m  lower  triangular  matrix  and  (7  is  an  m  x  n  “modified”  upper  triangular  ma¬ 
trix  in  the  sense  that  all  entries  in  U  below  the  diagonal  entries  un,  tt22,  ■■■,Unn  are  zeros , 
even  when  U  is  not  square.  The  format  of  the  matrices  is: 

0  *  *  *  * 

0  0*** 

0  0  0  0  * 

When  we  factor  A  into  LU  we  can  solve  the  equation  Ax  =  b  more  rapidly.  GKven; 

Ax  =  b, 

we  substitute  A  =  LU,  obtaining 

LUx  =  b. 

Let  y  —  Ux  and  solve  the  pair  of  equations, 

Ly  =  b 
Ux  =  y. 

— ^ 

We  solve  Ly  =  b  using  forward  substitution  and  then  plug  the  solution  y  into  the  equation 
Ux  =  y  and  solve  for  x  using  back  substitution.  This  pair  of  equations  is  easy  to  solve  be¬ 
cause  L  and  U  are  triangular  and  we  can  almost  read  the  solution  off  of  the  matrix.  Why 
would  we  want  to  solve  a  linear  system  using  LU  decomposition  when  we  have  already 
stated  that  Glaussian  elimination  is  frequently  the  quickest  and  least  computationally  ex¬ 
pensive  method  for  solving  linear  systems?  It  turns  out  that  solving  a  system  of  equations 
Ax  =  b  once  by  either  method,  takes  approximately  the  same  amount  of  work.  In  both 
methods  we  use  Gaussian  elimination  to  reduce  the  matrix  A  to  row  echelon  form,  then  we 
solve  for  the  variables  using  substitution.  What  happens  if  we  decide  we  want  to  solve  a 
system  of  equations  using  the  same  matrix  A  but  a  different  vector  6?  This  is  a  realistic 
possibility  in  real  world  problems  and  we  should  keep  in  mind  that  most  real  world  prob¬ 
lems  will  involve  a  matrix  A  that  is  significantly  larger  that  those  with  which  we  have  been 
working.  It  is  not  unreasonable  to  have  a  matrix  A  which  is  100  x  100  in  size.  So,  if  we 
keep  Ax  and  change  b,  using  Gaussian  elimination,  we  have  to  start  at  the  beginning  by  re- 


10  0  0 

*10  0 
**10 
*  *  *  1 
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ducing  the  augmented  matrix  to  row  echelon  form  and  then  solve  for  x  using  substitution. 
However,  if  we  used  LU  decomposition  we  have  already  formed  L  and  U,  and  do  not  have 
to  use  Gaussian  elimination  to  reduce  the  matrix  A  to  the  matrix  U  again.  All  we  have  to  do 
is  solve  Ly  =  b  using  forward  substitution  and  then  Ux  =  y  using  backward  substitution; 
much  less  work! 

Unfortunately,  L  and  U  will  not  always  be  given  to  us,  so  we  need  to  learn  how  to 
find  the  LU  factorization  of  a  matrix  A.  Here  is  the  procedure  for  a  general  LU  decompo¬ 
sition 


1.  Use  Gaussian  Elimination  to  reduce  the  matrix  A  to  the  row  echelon  form 

U. 

2.  Construct  L  so  that  the  same  sequence  of  row  operations  which  reduced  A 
to  U  will  reduce  L  to  I. 

Let’s  look  at  this  a  little  closer.  We  want  to  transform  the  matrix  A  to  the  upper 
triangular  matrix  U  using  a  sequence  of  elementary  row  operations  E\,E2,  ...En'. 

EnEn-i...EiA  =  U.  '  (IV5) 

Then  we  can  obtain  the  equation, 

A  =  LU 

by  multiplying  on  both  sides  by  {EnEn-\...EiY^-. 

(K£^n-l--El)"^  A  =  (E,,En-i...Ei)-^  U, 

which  simplifies  to: 

—  {EnEn-l--Ei)  ^  U. 

If  we  let  {EnEn-i...Ei)~'^  =  L,  we  get 

A  =  LU. 

Step  2  in  the  procedure  is  to  construct  L  so  that  the  same  sequence  of  row  operations  which 
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reduced  AtoU  will  reduce  L  to  I.  Let’s  see  if  this  works  on  L: 

{.EnEn-l-.-Ex)  L  =  {EnEn-l---Ei)  ^ 

We  have  formed  L  as  we  said  we  would.  This  process  is  rather  involved,  but  gives  an  idea 
of  what  is  happening  in  theory.  Just  as  we  said  that  Gaussian  elimination  will  not  produce 
a  unique  triangular  reduction  of  the  matrix  A,  this  procedure  will  not  produce  a  unique  LU 
factorization  of  the  matrix  A.  If  we  want  a  unique  LU  Decomposition,  we  have  to  place 
additional  requirements  on  the  process.  In  this  text  we  will  focus  on  LU  decomposition  of 
square  matrices  where  L  is  unit  lower  triangular  and  U  is  upper  triangular.  We  will  consider 
only  those  matrices  A  which  can  be  factored  using  row  replacement  operations.  This  LU 
decomposition,  if  it  exists,  is  unique. 


1  2  1 

Example  4.20  Find  the  LU  factorization  of  the  matrix  A  =  2  3—1 

-112 

Since  the  matrix  A  is  3  x  3,  the  matrices  L  and  U  will  also  be  3  x  3.  We  begin  with  A 
and  a  shell  of  a  unit  lower  triangular  matrix  for  L.  Let  be  the  multiplier  of  the  pivot 
which  will  be  added  to  row  i  to  make  the  entry  aij  a  zero.  Reduce  AtoU  using  Gaussian 


elimination.  Record 


in  position  U  of  L. 


1  2 
2  3 
-1  1 


Add  —2  times  row  1  to  row  2.  m2i  =  —2. 
Add  1  times  row  1  to  row  3.  msi  =  1. 


10  0 
L=  10 
1 


1  2  1 

=  0-1  -3 

0  3  3 

Add  3  times  row  2  to  row  3.  17132  =  3. 


1  0  0 
L=  2  10 
-1  1 


1  2  1 
U=  0-1-3 
0  0-6 


1  0  0 
2  1  0 
-1  -3  1 


This  completes  the  factorization  of  A  into  L  and  U.  We  can  check  our  work  by  multiplying 
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LU  to  see  if  the  result  is  A.  This  gives  us; 


LU  = 


■  1  0  0" 

[12  1  1 

'12  1  ■ 

2  10 

o 

1 

{ 

CO 

2  3-1 

1 

\ — 1 

CO 

1 

1 — 1 

1 

_ 1 

0  0-6 

-1  1  2 

=  A. 


It  works! 


The  procedure  employed  in  the  previous  example  can  be  summarized  as  follows; 

1 .  Form  U  by  reducing  the  matrix  A  to  upper  triangular  form  using  row  replace¬ 
ment  (add  a  multiple  of  one  row  to  another  row)  only.  Do  not  use  row  interchanges 
or  scaling. 

2.  Form  L  by  starting  with  a  unit  lower  triangular  matrix  shell  and  fill  in  the 
blank  spaces  by  storing  the  negative  of  the  multiplier  of  the  pivot  in  the  correspond¬ 
ing  row  in  L. 

3.  Check  your  solution  by  multiplying  LU  to  make  sure  the  result  is  A. 

An  LU  decomposition  will  not  always  exist.  However,  if  the  matrix  A  can  be  re¬ 
duced  to  row  echelon  form  without  using  row  interchanges,  an  LU  decomposition  will 
exist. 

If  row  interchanges  are  performed  on  a  nonsingular  matrix,  then  the  product  of  L 
and  ?7  wil  be  a  matrix  which  is  a  row  permutation  of  A.  For  some  permutation  matrix  P 
we  have; 

PA  =  LU. 

A  note  about  computers.  Most  computer  programs  will  compute  the  LU  decompo¬ 
sition  where  L  is  unit  lower  triangular.  Instead  of  storing  two  new  matrices  L  and  U,  the 
computer  will  overwrite  the  matrix  A  with  the  matrices  L  and  U  storing  only  the  multipliers 
of  L  in  the  lower  portion  of  U  instead  of  storing  all  of  L. 


Example  4.21  Let  A  = 


1  2  1 
2  3-1 
-1  1  2 


The  LU  decomposition  for  A  is 

1 

2 

0  0  ■ 
1  0 

1 - 

1 

\ — 1 
, 

rH  O 

1 _ 

-1 

-3  1 

[  0  0  -6  J 

.  The  computer 
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will  replace  the  matrix  A  with  the  matrix 


1  2  1 
2  -1  -3 

-1  -3  -6 


D.  DETERMINANTS 

Now  we  are  going  to  study  determinants.  The  determinant  is  a  number  assigned  to 
a  square  matrix  which  may  be  used  to  characterize  the  matrix  in  some  way,  for  example, 
singular  or  nonsingular.  Calculating  the  determinant  of  a  matrix  is  another  concept  which 
has  more  theoretical  application  than  computational  value  when  a  matrix  is  larger  than  4x4 
in  size.  First,  we  will  learn  how  to  compute  the  determinant.  Then  we  will  use  the  determi¬ 
nant  to  solve  the  linear  system  Ax  =  b.  Common  notations  for  the  determinant  of  a  matrix 
A  are 

det(A),  or  |A| . 

If  the  matrix  is  1  x  1  or  2  x  2  in  size,  the  determinant  can  be  calculated  with  little  effort. 


Example  4.22  Let  A  =  [3],  and  let  B  = 


12  7 
3  1 


Find  det  (A)  and  det(B). 


Solution: 

det  (A)  ==  3. 


det(5)  =  12  •1-7-3 
=  12-21 
=  -9. 


When  a  matrix  A  is  1  x  1,  the  determinant  is  equal  to  the  value  of  the  single  element 
in  the  matrix. 

If  A  =  [uii] ,  then  det(A)  =  an- 

When  a  matrix  A  is  2  x  2,  the  determinant  is  calculated  by  a  simple  formula. 


If  A  = 


a  b 
c  d 


,  then  det  (A)  =  ad  —  be. 
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We  used  this  formula  when  we  were  computing  the  inverse  of  a  2  x  2  matrix.  Recall,  we 
said  if  ad  -  6c  7^  0,  then  the  2  x  2  matrix  is  invertible/nonsingular.  Now  we  know  if  the 
determinant  of  a  2  x  2  matrix  is  not  equal  to  zero,  then  the  matrix  is  nonsingular,  and  if  the 
determinant  of  a  2  x  2  matrix  is  equal  to  zero,  then  the  matrix  is  singular.  We  summarize 
this  statement  in  the  following  theorem  relating  determinants  to  inverses  of  matrices.. 

Theorem  4.4  Annxn  matrix  is  invertible  if  and  only  if  its  determinant  is  nonzero. 

We  need  a  way  to  compute  the  determinant  of  a  matrix  which  is  larger  than  2x2. 
We  will  use  cofactor  expansion. 

1.  Cofactor  Expansion 

Cofactor  expansion  is  a  method  for  computing  the  determinant  of  a  matrix.  In  order 
to  calculate  the  determinant  of  matrices  larger  than  2  x  2  in  size,  we  must  first  understand 
the  concept  of  a  submatrix.  A  submatrix  of  a  matrix  A  is  a  matrix  formed  as  the  result  of 
deleting  certain  rows  and/or  columns  from  the  matrix  A. 

■  1  3^-3' 

Example  4.23  Let  A  =  ~4  ~2  _5  _7  •  The  submatrix  A23  is  formed  by  delet- 

_  -2  -4  ^  5 

ing  row  2  and  column  3  (underlined  above)  from  the  matrix  A. 

1  3  -3  ■ 

4  2  -7  . 

-2  -4  5 

In  general,  given  the  matrix  A,  the  submatrix  A^j  is  formed  by  deleting  row  i  and 
column  j  from  the  original  matrix  A.  Using  submatrices,  we  can  develop  a  recursive  defi¬ 
nition  of  the  determinant.  Recursive  means  we  calculate  any  later  term  in  a  formula  from 
the  terms  that  precede  it.  Let’s  look  at  an  example. 

■  1  2  5  ■ 

Example  4.24  Let  A  =  3  4  -2  .  Find  |A|. 

2-3  1  J 

Solution: 
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detof2x2  detof2x2  detof2x2 

submatrix  subraatrix  submatrix 


=  1  (-2) +  -2(7) +5  (-17) 

=  -101. 

We  found  the  determinant  of  the  matrix  A,  a  3  x  3  matrix,  using  the  determinants  of  three 
2x2  submatrices. 


In  general,  we  can  find  the  determinant  of  an  n  x  n  matrix  using  the  determinants  of  n 
submatrices  of  dimensi  on  (n  -  l)x(n  -  l)whenevern  >  2.  Thus,  we  find  the  determinant 
of  a  4  X  4  matrix  by  first  finding  the  determinants  of  three  3x3  submatrices,  and  we  find 
the  determinants  for  each  of  the  3  x  3  submatrices  by  first  finding  the  determinants  of  the 
two  corresponding  2x2  submatrices.  The  formula  we  used  in  the  example  is 

det  (A)  =  dot  All  —  ®12  det  A12  +  Uis  det  Ajg. 


Notice  the  alternating  signs.  This  formula  can  be  generalized  as 

3 

det  (A)  =  ^  (-1)^'^^  aij  det  Aij, 
i=i 


which  means 


3 


^  de+^ 

alternating  sign  I  det  of  submatrix 
sum  over  row  1  col  j 

cols  j  of  A 

where  Aij  is  the  submatrix  obtained  by  deleting  row  1  and  column  j  from  A.  The  term 
(“1)^^^  det  Aij  is  called  the  Ij  cofactor  of  A.  Our  definition  of  the  determinant  for  an 
n  X  n  matrix  is: 

n 


det  (A)  =  ^  (-1)  aij  det  Ai^, 

j=i 

which'is  called  the  cofactor  expansion  along  the  first  row  of  A.  We  can  generalize  even 
further  using  the  term  (—1)*^^  det  Ajj  which  is  the  ij  cofactor  of  A.  Then  we  can  compute 
the  determinant  of  an  n  x  n  matrix  A  using  the  cofactor  expansion  along  any  row  or  column 
of  A.  Hence,  the  determinant  can  be  defined  as  the  cofactor  expansion  along  the  ith  row  of 
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A: 

n 

det  (^)  -  Oy  det  Aij, 

i=l 

where  row  i  is  fixed  and  we  sum  along  the  columns  of  A. 


■  1  2  5  ■ 

Example  4.25  Let  A  =  3  4  —2  ,  the  same  matrix  as  in  our  previous  example 

2-3  1  J 

Compute  1^1  using  cofactor  expansion  along  the  2nd  row  of  A 

Solution: 


We  write  the  general  formula  with  i  =  2: 

3 

det  {A)  =  53  a2j  det  A2J, 

J=i 

which  gives  us 

det  (A)  =  (-1)2+^  3-  ^  +(-1)2+2. 4. 

det  of  2x2 
submatrix 

det  (A)  =  (-1)  (3)  (17)  +  (1)  (4)  (-9)  +  (-1)  (-2)  (-7) 
det  (A)  =  —101. 

This  is  the  same  solution  we  got  when  we  computed  the  determinant  using  the  cofactor 
expansion  along  the  1st  row  of  A. 

Similarly,  the  determinant  can  be  defined  as  the  cofactor  expansion  along  the  jth 
column  of  A. 

n 

det(A)  =  ^(-l)‘+'ai,det4i. 

where  column  j  is  fixed  and  we  sum  along  the  rows  of  A. 


1  5 

2  1 

+  (-1)2+3. 

-2.  1  2 
2-3 

det  of  2x2 

det  of  2  X  2 

submatrix 

submatrix 

[12  5 

Example  4.26  Let  A=  3  4—2 

[2-3  1 

expansion  along  the  2nd  column  of  A. 


,  the  same  matrix.  Compute  |A|  using  cofactor 


Solution: 
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We  write  the  general  formula  with  j  —  2: 

3 


det  {A)  =  ^  ai2  det  Ai2 


i=l 

which  gives  us; 

det(44)  =  (-l)'+^2- 

\ 

3  -2 

2  1 

+  (-l)"^''-4-  2  1 

-3-  ^  ^ 

3-2 

det  of  2x2 

det  of  2  X  2 

det  of  2  X  2 

submatrix 

submatrix 

submatrix 

det  (A)  =  (-1)  (2)  (7)  +  (1)  (4)  (-9)  +  (-1)  (-3)  (-17) 
det  (A)  =  —101. 

This  is  the  same  solution.  Good! 


If  the  matrix  A  has  a  row  or  column  which  consists  mostly  of  zeros,  then  choose 
the  row/column  which  consists  mostly  of  zeros  as  the  row/column  along  which  to  expand. 
This  will  reduce  the  number  of  computations  needed  to  calculate  det  (A)  since,  if  =  0, 
then  the  associated  term  in  the  cofactor  expansion  will  also  be  zero. 

r -2  5  2  ■ 

Example  4.27  LetA=  4  —2  —1  .  Compute  [A]  using  cofactor  expansion  along 

[  0  3  Oj 

the  3rd  row  of  A  (because  this  row  has  two  zeros). 

Solution: 

We  write  the  general  formula  with  i  =  3  : 

3 

det  (A)  =  (-1)^^^  asj  det  Azj, 

j=i 

which  gives  us; 

det  (A)  =  (-1)^+^  •  0  •  det  (^i)  +  (-1)^+2 . 3  .  (-1)^+^  .  0  •  det  {A33) 

The  first  and  third  terms  drop  out  leaving  us  with; 

det(A)  =  (-l)(3)|  _l 

=  (-l)(3)(-6) 

=  18. 
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This  example  illustrates  the  next  theorem. 

Theorem  4.5  If  an  nx  n  matrix  A  has  a  row  or  column  of  all  zeros,  then  det  (A)  =  0. 


Let’s  try  another  example. 


'  2 

3 

-2 

3  ' 

2 

0 

0 

0  ■ 

Example  4.28  Let  A  = 

0 

0 

-1 

0 

1 

-3 

-4 

-1 

and  let  B  = 

3 

-1 

-1 

-2 

0 

-3 

0 

0 

0 

0 

0 

-2 

5 

1 

4 

5 

Find \A\  and  \B\. 

Solution: 

To  find  det(A),  use  cofactor  expansion  along  the  first  column  since  the  first  column  consists 
mostly  of  zeros.  Fix  j  =  1: 


det{A)  =  J2{-iy+\iidetAn 

i=l 

This  gives  us  the  equation: 


det  (A)  =  (-1)^+^  (2) 


-1  1  -4 

0  -3  -1 
0  0-2 


All  other  terms  drop  out  because  the  elements  ^nd  are  zeros.  Continue  by 

finding  the  determinant  of  the  3  x  3  submatrix  using  cofactor  expansion  along  the  first 
column  because  the  first  column  consists  mostly  of  zeros.  Fix  j  =  1.  We  now  have 


det  (A)  =[(-!)>+*  (2)]  (-l)*+'(-l) 


-3  -1 
0  -2 


All  other  terms  drop  out  because  the  elements  U21  ^iid  of  the  3x3  submatrix  are  zeros. 
Continue  by  finding  die  determinant  of  the  2  x  2  submatrix  using  the  formula  ad  -  be, 
obtaining 


det  (^)  =  [(-!)■+'  (2)]  [(-!)*+■  (-1)]  [(-3)  (-2)  -  (-1)  (0)) . 
Simplifying,  we  get 

det(2t)  =  (2)(-l)(-3)(-2)  =  -12. 

Notice  that  the  matrix  A  is  upper  triangular  and  the  determinant  turned  out  to  be  the  product 
of  the  entries  on  the  main  diagonal. 

(2)(-l)(-3)  (-2)  =  -12 
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To  find  det(B),  use  cofactor  expansion  along  the  first  row  since  the  first  row  consists  mostly 
of  zeros.  Fix  i  =  l  : 


4 

det  {B)  =  (-1)^+^'  aij  det 

i=i 


=  (-1)“  (2) 


-10  0 
-2  -3  0 
14  5 


All  other  terms  drop  out  because  the  elements  oi2,<ii3,  and  ai4  are  zeros.  Continue  by 
finding  the  determinant  of  the  3  x  3  submatrix  using  cofactor  expansion  along  the  first  row 
because  the  first  row  consists  mostly  of  zeros.  Fix  i  =  l.  Then 


det  (B)  =  [(-1)1+^  (2)]  (-1)1+^  (-1) 


-3  0 
4  5 


All  other  terms  drop  out  because  the  elements  012  and  013  of  the  3  x  3  submatrix  are  zeros. 
Continue  by  finding  the  determinant  of  the  2  x  2  submatrix  using  the  formula  ad  -  be, 
obtaining 


det  (B)  =  [(-!)■+'  (2)]  [(-!)’+'  (-1)]  [(-3)  (6)  -  (0)  (4)] . 

Simplifying,  we  get 

det(B)  =  (2)  (-l)(-3)  (4)  =  30. 

The  matrix  B  is  lower  triangular  and  the  determinant  turned  out  to  be  the  product  of  the 
entries  on  the  main  diagonal: 

(2)  (-1)  (-3)  (5)  =  30.  ■ 


From  the  above  example,  we  can  see  a  nice  feature  of  triangular  matrices. 

Theorem  4.6  If  the  matrix  A  is  ann  x  n  triangular  matrix,  the  det  (A)  is  equal  to  the 
product  of  the  entries  on  the  main  diagonal 

It  would  appear  that  given  an  n  x  n  matrix  A,  the  determinant  is  easier  to  compute 
if  we  can  transform  the  matrix  A  to  a  triangular  matrix.  Clearly,  an  n  x  n  matrix  A  is  row 
equivalent  to  an  upper  triangular  matrix  which  is  obtained  using  Gaussian  elimination.  The 
questiOT  is,  how  do  elementary  row  operations  affect  the  determinant?  When  elementary 
row  operations  are  performed  on  an  n  x  n  matrix  A ,  the  determinant  of  the  new  matrix  will 
change  in  the  following  ways  each  time  a  row  operation  is  performed: 

Effect  of  row  operations  on  the  determinant  of  a  matrix. 
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1 .  If  a  multiple  of  one  row  of  the  matrix  A  is  added  to  another  row  to  produce 
the  matrix  Ai,  the  determinant  of  the  new  matrix  is  the  same  as  the  determinant  of 
the  original  matrix. 

det  Ai  =  det  A. 

2.  If  two  rows  of  the  matrix  A  are  interchanged  to  produce  the  matrix  A^ ,  the 
determinant  of  the  new  matrix  is  equal  to  minus  the  determinant  of  the  original 
matrix. 

det  Ai  =  —  det  A. 


3.  If  one  row  of  the  matrix  A  is  multiplied  by  a  scalar  c  to  produce  the  matrix 
Ai,  the  determinant  of  the  new  matrix  is  equal  to  c  times  the  determinant  of  the 
original  matrix. 

det  Ai  =  (c)  det  A. 


Example  4.29  Let  A  = 


1  3  0 

-2  4  -1 
0  5  0 


.  Compute  |i4|. 


Solution: 


Use  Gaussian  elimination  to  change  the  matrix  A  to  row  echelon  form. 


A  = 


1  3  0 

-2  4  -1 
0  5  0 


Add  2  times  row  1  to  row  2.  The  determinant  is  unchanged. 


15  0 

0  10  -1  . 

0  5  0 

Add  ^  times  row  2  to  row  3.  The  determinant  is  unchanged. 

■  1  5  o' 

0  10  -1  . 

_0  0  -1/2 

This  matrix  is  upper  triangular.  By  Theorem  4.6,  the  determinant  is  equal  to  the  product 
of  the  entries  on  the  main  diagonal.  The  determinant  is  unchanged  by  the  row  operations 
applied. 

det  (A)  =  det  (U)  =  (1)  (10)  fi)  =  5. 
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■  1  3  -2  ■ 

Example  4.30  Let  A  =  —2  —6  5  .  Compute  \A 

-17  0  J 


Solution: 


Use  Gaussian  elimination  to  change  the  matrix  A  to  row  echelon  form. 

■  1  3  -2  ■ 

-2  -6  5 

-17  0 

Add  2  times  row  1  to  row  2.  The  determinant  is  unchanged. 

1  3  -2  ■ 

0  0  1. 

-17  0 

Add  1  times  row  1  to  row  3.  The  determinant  is  unchanged. 

1  3  -2  ■ 

0  0  1. 

0  10  -2 

Interchange  rows  2  and  3.  The  determinant  of  the  new  matrix  is  equal  to  (—1)  times  the 
determinant  of  the  previous  matrix. 


0  10  -2  . 

[O  0  1  J 

This  is  an  upper  triangular  matrix.  The  determinant  is  equal  to  the  product  of  the  entries  on 
the  main  diagonal.  The  determinant  has  changed. 

det  (U)  =  —  1  det  (A) . 

Remember,  we  are  trying  to  solve  \A\;  therefore, 

det  (A)  =  -1  det  (U)  =  (-1)  (1)  (10)  (1)  =  -10 

Suppose,  instead  of  calculating  the  determinant  at  this  point,  we  had  taken  one  more  step 
by  multiplying  the  second  row  by  the  scalar  A.  xhe  determinant  of  the  new  matrix  is  equal 
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to  times  the  determinant  of  the  previous  matrix. 

■  1  3  -2  ■ 

0  1  -1/5  . 

0  0  1 

This  is  upper  triangular.  The  determinant  is  equal  to  the  product  of  the  entries  on  the  main 
diagonal.  The  determinant  has  changed  in  two  ways,  once  by  interchanging  rows  and  a 
second  way  by  multiplying  a  row  by  a  scalar. 

det(!7)  =  (-l)  (’ildet(A). 

Again,  stay  focused,  we  are  trying  to  find  \A\ ;  therefore, 

det  (A)  =  -10  det  (£/)  =  (-10)  (1)  (1)  (1)  =  -10. 

Whew!  The  same  answer. 

Sometimes  the  determinant  will  be  easier  to  compute  using  a  combination  of  both 
elementary  row  operations  and  cofactor  expansion. 

'3  21-2’ 

Example  4.31  LetA=  ^  ^3  5  •  Compute  |A1. 

-3-23  5 

Solution: 

Begin  by  adding  1  times  row  1  to  row  4.  The  determinant  is  unchanged  by  the  row  operation. 

■  3  2  1  -2  ■ 

0  4  6  8 

0  2  3  5  • 

0  0  4  3 

Use  cofactor  expansion  along  the  first  column  because  this  column  consists  mostly  of  zeros 
and  all  but  one  term  drops  out  of  the  summation.  Fix  j  =  1, 

r  4  6  8  ] 

(-1)^‘^^(3)  2  3  5  . 

[  0  4  3  J 

Compute  the  determinant  of  the  3x3  submatrix  using  elementary  row  operations  .  Add  ~ 
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times  row  1  to  row  2.  The  determinant  is  unchanged. 


(-1)'+'  (3) 


4  6  8 
0  0  1 
0  4  3 


At  this  point  we  have  two  options.  We  can  interchange  rows  2  and  3,  or  we  can  use  cofac¬ 
tor  expansion  along  the  first  column  of  the  3  x  3  submatrix.  We’ll  interchange  rows  here. 
Try  cofactor  expansion  on  your  own  to  see  if  you  get  the  same  solution. 

Interchange  row  2  with  row  3.  The  determinant  of  the  new  matrix  is  equal  to  minus  the 
determinant  of  the  previous  matrix. 


(-!)'■''  (3) 


4  6  8 
0  4  3 
0  0  1 


This  submatrix  is  upper  triangular,  so  the  determinant  is  equal  to  the  product  of  the  entries 
on  the  main  diagonal.  The  determinant  has  changed  because  of  the  row  interchange. 

det  (U)  —  —  det  (A) . 

We  want  the  determinant  of  the  matrix  A. 


det  (A)  =  -  det  (U)  =  (-1)  (1)'+'  (3)  (4)  (4)  (1)  =  -48. 


At  this  point  we  are  ready  to  learn  a  few  properties  of  determinants  and  how  they 
relate  to  some  of  the  concepts  presented  earlier  in  the  book. 


Properties  of  Determinants 


1.  The  rows  or  columns  of  the  matrix  A  are  linearly  dependent  if  and  only  if 
det  (A)  =  0  .  (Recall,  rows  or  columns  of  a  matrix  are  linearly  dependent  when  2 
or  more  rows  or  columns  are  the  same,  multiples  of  another  row  or  column,  or  have 
a  row  of  zeros.) 

2.  The  rows  or  columns  of  the  matrix  A  are  linearly  independent  if  and  only  if 

det  (A)  0. 

3.  The  determinant  of  the  transpose  of  a  matrix  A  is  equal  to  the  determinant 
of  the  matrix  A. 

det  (A^)  =  det  (A) . 
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This  is  consistent  with  calculating  the  determinant  using  cofactor  expansion  along 
a  row  or  a  column  of  A,  because  column  operations  on  the  matrix  A  are  simply  row 
operations  on  the  matrix 

4.  Given  n  x  n  matrices  A  and  B, 

det  (AB)  =  det  (A)  det  (B) . 

Notice,  when  we  have  A  =  LU,  then; 

det  (A)  =  det  (LU)  =  det  (L)  det  (U) . 

Since  L  is  unit  lower  triangular,  det  (L)  =  1,  which  gives  us; 

det  (A)  =  det  (U) 

provided  the  only  elementary  row  operation  applied  was  row  replacement. 

5.  If  A  is  a  nonsingular  matrix,  the  determinant  of  the  inverse  to  the  matrix  A 
is  equal  to  the  inverse  of  the  determinant  of  the  matrix  A. 

det  (A~^)  =  [det  (A)]“^ 

We  can  use  the  determinant  to  find  the  solution  to  a  system  of  linear  equations  by 
applying  Cramer’s  Rule. 

2.  Cramer’s  Rule 

Cramer ’s  rule  is  a  formula  which  allows  us  to  solve  the  system  of  equations  Ax  =  b 
using  what  we  just  learned  about  determinants  instead  of  using  Gaussian  elimination  or  LU 
decomposition.  We  discuss  Cramer’s  rule  because  it  will  occasionally  appear  in  sci  ence  texts 
and  is  sometimes  useful  in  theoretical  calculations.  However,  the  formula  quickly  becomes 
inefficient  with  matrices  of  size  larger  than  3x3.  We  should  remember  that  Gaussian 
elimination  is  generally  the  fastest  method  for  solving  systems  of  equations. 

Before  we  define  Cramer’s  rule,  we  need  to  learn  about  a  different  type  of  matrix. 
Given  any  n  x  n  matrix  A  and  an  n  x  1  column  vector  6,  we  can  form  a  new  matrix  Aj(b) 
by  replacing  the  jth  column  of  the  matrix  A  with  the  vector  b. 
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■  1  3  5  1  ^  r  6  ■ 

Example  4.32  Let  A=  —2  2—1  ,  and  6  —  3  . 

[  3  4  0  J  18 

Fom  the  matrices  Ai(b),  A2(b),  and  A3(&). 

Solution: 

[  6  3  5  ■ 

Ai(b)=  3  2-1, 

18  4  0 

■  1  6  5  ■ 

A2(b)=  -2  3-1, 

3  19  0 

[13  6] 

As(b)  =-2  2  3. 

_  3  4  18 

We  can  use  the  determinants  of  the  matrix  A  and  the  new  matrices  Aj  (b)  to  solve  a 
system  of  linear  equation. 

Example  4.33  Given  the  linear  system  of  equations 

Xi  —  2x2  "I"  3:3  =  3 

2X\  “f*  2x2  3/3  =  6  , 

—Xi  +  23^2  +  33:3  =  5 

find  the  solution  vector  x  using  the  determinants  of  the  matrices  A  and  Aj{b). 

Solution: 

We  can  rewrite  this  system  of  equations  as  the  matrix  equation  Ax  =  b: 

‘1-2  1  ]  [  3;i  ]  [  3  ■ 

2  2-1  X2  =  e  . 

-1  2  3j[a;3j  [5 

Now  compute  the  determinants  of  A,  Ai{b),A2{b),  and  As(b): 

'1-2  1  ■ 

2  2  -1  ,  |A|  =  1(8)  4- 2(5) +  1(6)  =  24, 

-1  2  3 


Ai{b)  =  3  (8) +  2  (23) +  1(2)  =  72, 


3-2  1 

6  2-1 
5  2  3 
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=  1  (23)  -  3  (5)  +  1  (16)  =  24, 


■^2{b)  — 


1  3  1 

2  6-1 

-15  3 


As{b)  = 


1  -2  3 

2  2  6 

-1  2  5 


We  can  now  solve  for  x  as  follows: 


=  1  (-2) +  2  (16) +  3  (6)  =48. 


Xi 


det[Ai(6)]  _  72 
det(^)  24 


X2 


X3 


Hence,  the  solution  vector  is  x  = 


det[A2(6)]  _  24 
det(v4)  24 

det[^3(fe)]  _  48 
det(/i)  24 


3 

1 

2 


This  is  a  unique  solution. 


The  method  used  to  solve  the  system  in  the  above  example,  called  Cramer’s  rule,  is 
generalized  in  the  following  theorem; 


Theorem  4.7  Cramer'’s  Rule 

If  A  is  annxn  nonsingular  matrix  and  bis  annxl  vector,  then  the  linear  system  Ax  =  b 
has  the  unique  solution  x,  where  the  entries  of  x  are: 


Xj  = 


det[Aj(fc)] 
det(A)  ’  ^ 


l,2...,n. 


We  need  to  be  careful  not  to  read  anything  into  the  theorem..  If  det(>l)  =  0,  then 
the  matrix  A  is  singular  and  Cramer’s  rule  does  not  tell  us  whether  there  are  infinitely  many 
solutions  or  no  solutions. 


E.  EXERCISES 


1 .  Compute  the  inverses  of  the  following  matrices. 


B  = 


4  2 

-3  1  ’ 


(7  = 


4  0 
0  2 
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2.  Which  of  the  following  are  elementary  matrices? 


-2  0 
0  1  ’ 


1 

5  1  I  ’ 


C  = 


-1  0 
0  2  ’ 


D  = 

■  1  0  0  ■ 
0  0  1 

,  E  = 

1 

0 

0 

0  0 

_ 1 

,  F  = 

10  0  0 

0  10  0 

0 

0 

1 _ 

1  0  0 

5 

0  0  10 

0  10  1 

3.  Consider  the  matrix  A  = 


2  4 
0  1 


a)  Find  the  elementary  matrices  Ei  and  E2  such  that  E2E1A  =  I. 

b)  Write  as  a  product  of  two  elementary  matrices. 

c)  Write  A  as  a  product  of  two  elementary  matrices. 


4.  Solve  the  following  linear  system  using  the  solution  formula  x  =  A-^b 


Xi 

+ 

20^2 

+ 

=  3 

2xi 

+ 

CO 

+ 

4xs 

=  4 

4xi 

+ 

5X2 

+ 

9xs 

=  5 

5.  Find  the  inverse  of  the  following  matrices,  if  it  exists. 


h)B  = 


1  2  1 
4  7  2 

2  1  -3 
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d)D  = 


1  0  3 

-2  1  -9 

4  -1  16 


e)E  = 


1  3  -1 
0  1  2 
-10  8 


6.  Solve  the  equation  Ax  ^bhy  using  the  LU  factorization  given  for  A. 


A  = 


■  1  0  0' 

'3-5  2  ■ 

-1  ■ 

-1  10 

3  -2  1 

0  4-2 

0  0  1 

7 

-16 

Solve  the 
1  0  0 
4  1  0 
2  3  1 


;  equation  Ax  =  6  by  using  the  LU  factorization  given  for  A. 


2 

0 

0 


1  4 
3  -2 
0  -1 


b  = 


3 

11 

1 


8.  Find  the  LU  factorization  of  the  following  matrices. 


a) 


-2  4  3 

-4  10  3 

2  2  -11 


5  -1 

3  ■ 

b) 

15  1 

8 

_  -20  12  - 

•16 

■7-24 

-3 

c) 

28  -7  21 
-7  4  5 

-10 

9 

7  ■  1  21 

-5 

'2-1  6 ■ 

d) 

12  -1  39 

8  11  29 

9.  Compute  the  determinant  of  the  following  matrices  using  cofactor  expan¬ 
sion. 
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■  4 

-1  2  ■ 

'2  11' 

'10  2  1  ■ 

0 

5 

2  3 

2  1 

,  B  = 

-1  2  1 

1  -1  2 

,  ^7  = 

2  1-3-2 
-3123 

10.  Find  the  determinant  for  the  following  matrices  using  Gaussian  elimination. 


A  = 


■  1  2  -3  ■ 

1  7  -4 

,  B  = 

2  4-5 

1 

1 

3 

-5 

-2 

-1 

4 

3 

4 

3 

2 

-11 

-3 

0 

1 

-1 

11.  Combine  the  methods  of  Gaussian  elimination  and  cofactor  expansion  to 
compute  the  determinant. 


4  10  -6  -2 
3  0  1-3 

-4  0  2  5 

2  5  0  -1 


12.  Use  determinants  to  decide  if  the  following  vectors  are  linearly  dependent. 


13.  Use  Cramer’s  rule  to  compute  the  solution  for  the  following  linear  systems. 

.  5a;i  +  6x0  =  —9 

2x,  +  =  -2 
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Xi  +  X2  +  2xz  =  1 

b)  x-i  +  2x2  -  xz  =  -2 

2x\  +  62^2  +  2x3  =  10 

5xi  +  22;2  —  62:3  =  10 

c)  4xi  +  22:2  -  62:3  =  1 

3®!  -  2^2  -  42:3  =  7 

, 2xi  -  5x2  =  1 

32?!  +  2^2  =  11 

.  42:1  +  62^2  =  2 

52^1  +  72;2  =  3 
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V  EIGENmLUES  AND  EIGENVECTORS 


Eigenvalues  and  eigenvectors  are  used  in  the  study  of  discrete  and  continuous  dy¬ 
namical  systems,  differential  equations,  and  many  more  areas  of  pure  and  applied  math¬ 
ematics.  In  Chapter  IV  we  studied  linear  transformations.  We  looked  at  the  effect  that  a 
matrix  A  might  have  on  a  vector  x.  We  said  the  linear  transformation  is  the  action  of  the 
matrix  A  on  the  vector  x.  The  study  of  eigenvalues  and  eigenvectors  involves  a  linear  trans¬ 
formation  A  (a;)  in  which  the  matrix  A  transforms  a  nonzero  vector  x  into  a  scalar  multiple 
A  of  itself 

A  (x)  =  Xx. 

A.  REAL  EIGENVECTORS  AND  EIGENmLUES 

Let  A  be  an  n  X  n  matrix  which  is  a  linear  transformation  from  i?"  i?”.  Is  there  a 

nonzero  vector  x  and  a  scalar  A  for  which  Ax  =  Xx?  If  such  a  vector  and  scalar  exi  st,  then  we 
call  A  an  eigenvalue  of  A  and  x  an  eigenvector  of  A  associated  with  the  eigenvalue  A.  The 
matrix  A  may  have  several  eigenvalues  associated  with  it.  Each  eigenvalue  has  infinitely 
many  associated  eigenvectors.  So,  we  are  looking  for  vectors  which  are  transformed  by  the 
matrix  A  into  scalar  multiples  of  themselves. 


Example  5.1  Let  A  =  2  3 

Are  X  and  y  eigenvectors  of  A? 


y  = 


7 

3 


5  4 
2  3 


-4 

-2 


-28 

-14 


=  7x. 


The  vector  x  is  transformed  by  the  matrix  A  into  a  vector  7x.  Therefore,  x  is  an  eigenvec¬ 
tor  of  A  associated  with  the  eigenvalue  A  =  7. 


■54' 

■  7  ■ 

■  47  ■ 

■  7  ‘ 

2  3 

.4.  A  y 

3 

_ 

23 

L 

7^  A 

3 

Ay  = 

We  cannot  find  any  A  such  that  Ay  =  Ay;  therefore,  y  is  not  an  eigenvector  of  A. 
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Example  5.2  Let  A  = 


Show  that  A  =  1  is  an  eigenvalue  of  A. 


Solution: 


1  is  an  eigenvalue  of  A  if  there  exists  a  nonzero  x  which  satisfies  the  equation; 


Substitute  A  into  the  equation: 


Ax  =  lx 


5  4  .  xi 

2  3  X2  ~  X2 


Compute  the  matrix  multiplication  on  the  left  side  of  the  equation: 


5a;i  +  4a;2 
2xi  -|-  3x2 


Two  vectors  are  equal  if  the  corresponding  components  are  equal: 

5xi  +  4x2  = 

2xi  3X2  =  X2 

Subtract  xi  and  X2  from  the  right  hand  sides  of  the  equations: 

4xi  +  4x2  =  0 

2xj  -f-  2x2  ~  0- 


Solve  the  homogeneous  linear  system. 


Add  row  1  to  row  2 

’4  4  0' 

2  2  0  " 


4  4  0 
0  0  0’ 


Since  there  is  a  row  of  zeros,  there  is  a  free  variab.  e.  Let  X2  be  the  free  variable.  Then 
xi  =  — X2.  The  general  solution  is  x  =  s  s  ^0 

L  ^2  J  L  ^  J  ’ 

We  found  a  vector  x  such  that  ylx  =  lx;  therefore,  1  is  an  eigenvalue  of  the  matrix  A. 


Once  we  find  an  eigenvector  x  of  an  n  x  n  matrix  A,  we  can  find  infinitely  many 
eigenvectors,  associated  with  the  same  eigenvalue  A,  by  multiplying  the  eigenvector  x  by  a 


128 


scalar  c,c  ^  0.  The  vector  cx  is  an  eigenvector  of  A  associated  with  A,  since; 


A(cx)  =  c{Ax)  =  c(Xx)  =  X{cx). 


Example  5.3  Let  A  = 

,  -  [  -6  1 
vector  re  =  „  . 


5  4 
2  3 


Then  A  =  7  is  an  eigenvalue  of  A  with  associated  eigen- 


We  show  that  cx  is  also  an  eigenvector  of  A  when  c  ^  0. 


5  4 
2  3 


-6c 

-3c 


-42c 

-21c 


The  above  equation  shows  that  A  (err)  =  X{cx);  therefore,  cx  is  an  eigenvector  of  the 
matrix  A  associated  with  the  eigenvalue  A  =  7. 


1.  Finding  Eigenvalues  and  Eigenvectors 

We  will  not  always  be  given  the  eigenvalues  or  eigenvectors  of  a  matrix  A.  There¬ 
fore,  we  need  to  learn  how  to  find  all  eigenvalues  of  a  square  matrix  and  all  eigenvectors 
associated  with  each  eigenvalue.  Eigenvalues  and  associated  eigenvectors  satisfy  the  equa¬ 
tion; 

Ax  =  Xx, 

where  ^  is  an  n  x  n  matrix  and  :r  is  an  n  x  1  vector.  We  can  rewrite  this  equation  as; 

Ax  —  Xx  —  0, 

where  0  is  the  n  x  1  zero  vector.  The  vector  x  can  also  be  represented  as  Ix,  where  /  is  the 
n  X  n  identity  matrix.  We  can  rewrite  the  above  equation  as; 

Ax  —  XI X  =  0. 

Then  we  can  factor  out  the  vector  x  to  get  the  equation 

{A  -  XI)x  =  0. 

Notice  this  equation  is  simply  a  homogeneous  system  of  linear  equations.  Recall,  homoge- 
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neous  linear  systems  are  always  consistent  with  either  the  trivial  solution  or  infinitely  many 
nontrivial  solutions.  We  want  the  nontrivial  solution  to  the  homogeneous  system.  The  ho¬ 
mogeneous  system  has  a  nontrivial  solution  if  and  only  if  {A  —  XI)  is  a  singular  matrix. 
Recall  when  we  say  {A  —  XI)  is  a  singular  matrix,  this  means  {A  —  XI)  is  not  row  equiv¬ 
alent  to  the  identity  matrix.  Therefore,  the  solution  vector  will  have  a  free  variable  and 
nontrivial  solutions.  We  know  {A  -  XI)  is  singular  if  and  only  if  det(A  -  XI)  =  0.  The 
equation  det(A  —  XI)  =  0  is  called  the  characteristic  equation.  We  will  use  the  character¬ 
istic  equation  to  find  the  eigenvalues  of  the  matrix  A. 


Theorem  5.1  Let  Abe  ann  x  n  matrix.  Then: 

1.  X  is  an  eigenvalue  of  A  if  and  only  if  X  satisfies  the  characteristic  equation 
det{A  —  XI)  =  0 

2.  If  X  is  an  eigenvalue  of  A  any  nontrivial  solution  of  {A  —  XI)x  =  0  is  an 
eigenvector  of  A  associated  with  X. 

Thus,  we  find  the  eigenvalues  of  A  by  solving  the  characteristic  equation 


det(A  - 

A/)  =  0. 

flu  —  A 

<^■12 

Clin 

^*■21 

®22  ~  A 

*  ’  ^2n 

^nl 

^n2 

Clnn  ^ 

=  0. 


Using  cofactor  expansion  on  A  to  find  the  determinant  of  (A-  XI)  will  produce  the  char¬ 
acteristic  polynomial  .  If  A  is  n  X  n,  the  characteristic  polynomial  will  have  degree  n  in  A. 
We  want  to  find  the  characteristic  polynomial  because  the  roots  of  the  characteristic  polyno¬ 
mial  are  the  eigenvalues  of  A.  Sometimes  polynomials  have  repeated  roots.  If  an  eigenvalue 
Aj  appears  as  a  root  of  the  characteristic  polynomial  p  times,  we  say  Aj  has  multiplicity  p. 


Example  5.4  Let  A  = 


5-2  6 

0  3-8 

0  0  5 


.  Then  det(A-XI) 


5- A  -2  6 

0  3- A  -8 

0  0  5  - A 


This  is  a  triangular  matrix;  therefore,  the  determinant  of  this  matrix  is  the  product  of  the 
main  diagonal  elements.  The  characteristic  polynomial  is  (5  —  A)^(3  —  A).  The  character¬ 
istic  polynomial  has  5  as  a  root  with  multiplicity  2  and  3  as  a  root  with  multiplicity  1.  We 
say  eigenvalue  5  has  multiplicity  2  and  eigenvalue  3  has  multiplicity  1 . 
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Counting  multiplicities,  there  are  n  roots  of  the  characteristic  polynomial,  some  of 
which  are  real  and  some  of  which  might  be  nonreal.  While  it  is  possible  to  have  repeated 
eigenvalues,  the  study  of  repeated  eigenvalues  is  a  bit  more  complicated  and  will  be  left 
for  a  future  course.  For  now  we  will  study  only  characteristic  equations  with  distinct,  real 
roots.  Example  5.4illustrates  the  following  theorem. 

Theorem  5.2  If  A  isannxn  triangular  matrix,  then  the  eigenvalues  of  A  are  the  entries 
on  the  main  diagonal. 

Be  careful !  If  A  =  LU ,  then  the  eigenvalues  of  U  are  its  diagonal  entries,  but  there 
is  no  reason  to  expect  A  to  have  the  same  eigenvalues. 

The  idea  behind  the  theorem  is  this.  If  we  have  a  triangular  matrix  A,  we  find  the 
eigenvalues  of  A  by  solving  the  characteristic  equation  det  (A  -  A/)  =  0  for  A.  The  matrix 
A  —  XI  looks  like 

ail  —  X  ai2  oi3 

A  XI  =  0  (X22  —  X  0,23 

0  0  033  —  X 

Recall  that  the  determinant  of  a  triangular  matrix  is  the  product  of  the  entries  on  the  main 
diagonal.  We  want  to  find  the  eigenvalues  of  A  which  satisfy  the  equation, 

(uii  —  A)  (022  —  A)  (033  —  A)  =  0. 

This  means  that  A  equals  one  of  the  entries  on  the  main  diagonal  of  A. 

Once  we  know  the  eigenvalues  of  the  matrix  A,  we  solve  the  homogeneous  equation 
~  A/)a;  =  0  for  x.  For  each  eigenvalue  A  of  A,  there  will  be  an  infinitely  many  solution 
vectors  associated  with  A. 

Example  5.5  Find  the  eigenvalues  and  all  associated  eigenvectors  of  the  matrix  A. 

r2  1  3 
A=  1  1  1 

_  1  -2  4 

Solution: 
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We  want  to  find  the  values  A  and  the  vectors  x  such  that 


{A  —  XI)x  =  0. 


Find  the  eigenvalues  using  the  characteristic  equation, 

det(j4  —  XI)  ~  0. 

[2  1  3 1  r  A  0  0  ] 

det{A-XI)  =  1  1  1  -  0  A  0 

[1-24J  [OOAJ 

2-  A  1  3 

1  1- A  1 

1  -2  4- A 

Using  cofactor  expansion  along  the  first  row  of  det(A  -  XI)  we  have: 

4-A]|-w|[i  4^]|+(3)|[1  ':2^' 

=  (2  -  A)  [(1  -  A)  (4-  A)  +  2]  -  [4  -  A  -  1]  +  (3)  [-2  -  (1  -  A)] 
=  (2  -  A)  [A^  _  5A  +  6]  -  [3  -  A]  +  3  [-3  +  A] 

=  -A^  +  TA^  -  12A 
=  (-A)  (A^  -  7A  +  12) 

=  (-A)  (A  -  4)  (A  -  3) 

Setting  (—A)  (A  —  4)  (A  —  3)  equal  to  0  and  solving,  we  find  roots 

A  =  0,  A  =  4,  A  =  3. 


Let  Ai  =  0,  A2  =  4,  A3  =  3.  Find  the  eigenvectors  for  each  eigenvalue  by  solving  the 
homogeneous  equation, 

{A  -  XI)x  =  0. 

Remember,  we  are  looking  for  a  nonzero  vector  x.  Since  we  are  looking  for  a  nontrivial 
solution,  the  matrix  A  —  XI  must  be  singular,  otherwise  A  —  XI  would  be  row  equivalent 
to  the  identity  matrix  and  the  only  solution  would  be  the  trivial  solution.  We  know  that  the 
matrix  A- XI  is  singular,  because  we  found  the  eigenvalues  A  by  solving  the  characteristic 
equation  det  (A  -  XI)  =  0.  When  we  perform  Gaussian  elimination  on  the  system,  we 
will  end  up  with  at  least  one  row  of  zeros.  This  means  that  there  will  be  at  least  one  free 
variable. 
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For  Ai  =  0: 


(2-0)  1  3  ■ 

{A-X1)=  1  (1-0)  1 

1  -2  (4-0) 

Solve  the  homogeneous  equation  (A  —  Xl)x  =  0.  Write  the  augmented  matrix: 


(2-0)  1  3  0 

1  (1-0)  10 

1  -2  (4-0)  0 

Add  5  limes  row  2  to  row  3 


Add  -1/2  times  row  1  to  row  2&3 

■  2  13  0* 

-  1  •  110  ^ 
1-240 


2  1  30  21  30' 

0  1/2  -1/2  0  ~  0  1/2  -1/2  0 

[O  -5/2  5/2  Oj  [o  0  0  0 

Since  there  is  a  row  of  zeros,  there  must  be  a  free  variable.  Let  xs  be  the  free  variable.  Set 

r  ' 

xs  =  r.  Then  x^  =  r  and  Xi  =  -2r.  The  general  solution  is  =  r  1  for  any  real 

[  1 

scalar  r. 

For  A2  =  4: 

‘  (2  -  4)  1  3  ■ 

(A-A/)=  1  (1-4)  1 

1  -2  (4-4) 

Solve  the  homogeneous  equation  {A  -  XI)x  =  0.  Write  the  augmented  matrix; 


(2-4)  1  3  0 

1  (1-4)  10 

1  -2  (4-4)  0 


Add  -3/5  times  row  2  to  row  3 

-2  13  0 

0  -5/2  5/2  0 
0  -3/2  3/2  0 


Add  1/2  times  row  1  to  row  2«S:3 

■  -2  1  3  0  ■ 

1-3  10 
1-200 


-2  13  0 

0  -5/2  5/2  0 
0  0  0  0 


Again,  one  row  is  entirely  zeros;  therefore,  there  must  be  a  free  variable.  Let  Xz  be 
variable.  Set  xz  —  s.  Then  X2  =  s  and  xi  =  2s.  The  general  solution  is  s  =  s 


any  real  scalar  s. 
For  A  =  3: 


the  free 
2  ■ 

1  for 
1 


(A  -  XI) 


(2-3)  1  3 

1  (1  -  3)  1 

1  -2  (4  -  3) 
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Solve  the  homogeneous  equation  {A  -  \I)x  =  0.  Write  the  augmented  matrix; 


Add  1  times  row  1  to  row  2&3 

(2-3)  1  3  0  1  r  -1  13  0' 

1(1-3)  10  ~  l-2  10-> 

1  -2  (4-3)  oj  [  1  -2  1  0 


Add  -1  times  row  2  to  row  3 

'-1  1301  [■-!  130' 

0-1  40~  0-140 

_0-14  0j  [0000 

Let  xz  be  the  free  variable.  Set  x^  =  t.  Then  X2  =  it  and  x^  =  7t.  The  general  solution  is 
■  7  1 

X  —  t  4  for  any  real  scalar  t. 


In  this  example,  A  has  an  eigenvalue  A  =  0.  This  only  happens  if  there  exists  x  ^  0 
such  that 

Ax  =  Ox  =  0 

This  equation  has  a  nontrivial  solution  if  and  only  if  A  is  not  invertible.  This  means  0  is  an 
eigenvalue  of  A  if  and  only  if  A  is  singular.  Let’s  look  at  an  application.  [Ref  3] 


Example  5.6  Two  companies  A  and  B  find  they  can  mutually  gain  by  cooperating.  By 
cooperating,  company  A’s  worth  will  increase  by  9%  of  company  B’s  worth,  and  company 
B’s  worth  will  increase  by  4%  of  company  A’s  worth.  However,  the  companies  will  only 
cooperate  if  their  values  increase  at  equal  percentages.  For  example,  if  both  companies  have 
initial  values  of  100  units,  after  cooperating,  company  A  will  be  worth  109  units  (a  gain  of 
9%)  and  company  B  will  be  worth  104  units  (a  gain  of  4%).  Clearly,  company  B  would  not 
consider  this  a  fair  partnership.  Let  Aq  and  Bq  be  the  starting  values  of  the  companies  before 
the  partnership.  Let  Ai  and  Bi  be  the  company  values  after  developing  a  partnership.  Find 
the  initial  values  Aq  and  Bq,  so  that  companies  A  and  B  realize  the  same  percentage  gains 
by  solving  the  linear  system, 

Aq  +  .09Bo  =  Ai 

MAo  +  Bo  =  Bi, 

with  corresponding  matrix  equation, 

1  .09 1  r  Ao  1  r  Ai 

.04  1  J  [  Ho  J  [  Hi 

In  order  for  the  companies  to  realize  the  same  percentage  gain  we  want  to  find  scalars  A 
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such  that 


A 


1 _ 

I 

- 1 

[B,\ 

We  can  set  the  two  quantities  equal  to  each  other: 


1  .09 

.04  1 


A) 

Bo 


=  A 


A) 

Bo 


If  this  equation  can  be  solved,  then  A  is  an  eigenvalue  of  the  matrix 


1 

.04 


Ao 

Bo 


is  an  eigenvector.  Solve  the  characteristic  equation  det(A  —  XI)  =  0. 


.09 

1 


and 


det(A  —  XI)  = 


1  -  A  .09 
.04  1  -  A 


=  (l-A)(l-A)-(.04)(.09) 
=  A^  -  2A  +  .9964. 
Solving  A^  —  2A  +  .9964  =  0  we  have 


A  =  1.06  or  .94. 

Since  the  resulting  values  of  the  companies  is  equal  to  A  times  the  starting  values  of  the 
companies,  the  companies’  values  would  decrease  if  we  let  A  =  .94,  which  is  less  than  1. 
We  will  disregard  this  value  and  try  to  find  an  eigenvector  for  A  =  1.06. 

■  1  -  1.06  .09  0  ■ 

.04  1  -  1.06  0 


-.06  .09  0 

[  .04  -.06  0  • 

Add  .04/.06  time  the  first  row  to  the  second  row: 

■  -.06  .09  0  ■ 

0  0  0- 

Let  Bo  be  the  free  variable  and  A)  =  1.5jBo.  The  starting  values  of  the  companies  must 
satisfy  the  relationship: 


The  percentage  gain  of  each  company  is  6%. 


This  next  theorem  relates  our  previous  study  of  linear  independence  to  eigenvectors 
of  a  matrix. 
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Theorem  5.3  Ifx-^  ,X2,...,Xr  are  eigenvectors  ofannxn  matrix  A  that  correspond  to  dis¬ 
tinct  eigenvalues  Ai ,  A2 , . . . ,  o/" A  the  vectors  Xi,X2,  ...,Xr  are  linearly  independent. 

B.  COMPLEX  NUMBERS 

In  section  A  we  found  that  the  eigenvalues  of  a  matrix  are  the  roots  of  its  charac¬ 
teristic  polynomial.  We  know  that  the  roots  of  polynomials  are  not  always  real;  some  roots 
may  be  complex.  This  suggests  that  some  eigenvalues  are  complex.  Ultimately,  we  want  to 
learn  how  to  find  complex  eigenvalues  and  eigenvectors.  We  begin  with  the  study  of  com¬ 
plex  numbers.  Consider  trying  to  take  the  square  root  of  a  negative  number,  such  as  \/^. 
We  cannot  do  this  with  any  of  the  tools  we  currently  possess.  However,  if  we  introduce  an 
imaginary  unit  i,  we  can  find  Let  the  imaginary  unit  i  —  We  can  develop  this 
a  little  further: 


i  =  a/^ 

Knowing  the  imaginary  unit  will  allow  us  to  find  the  square  root  of  a  negative  number.  Let 
k  >  0.  Then 

\/^  =  a/  (— 1)A;  =  =  iy/k. 

Example  5.7 

a/^  =  =  y/^y/4  =  i2  =  2i. 

The  imaginary  unit  allows  us  to  expand  our  current  number  system  to  include  imag¬ 
inary  numbers.  An  imaginary  number  is  any  number  of  the  form  ki,  A:  ^  0.  Imaginary 
numbers  allow  us  to  build  a  whole  new  set  of  numbers  called  the  complex  numbers.  A 
complex  number  .2;  is  a  number  of  the  form  z  =  a  +  where  a  and  b  are  real  numbers 
and  i  is  the  imaginary  unit  defined  above.  The  complex  number  z  has  a  real  part,  denoted 
re(z)  =  re(a  -|-  bi)  =  a,  and  an  imaginary  part,  denoted  im{z)  —  im(a  +  hi)  =  b.  We  will 
denote  the  complex  number  system  by  the  symbol  C. 
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Let’s  consider  the  relationship  of  the  complex  numbers  C  to  the  real  numbers  R. 
Every  complex  number  has  two  parts,  a  real  part,  re  {z^  —  a,  and  an  imaginary  part, 
im  (z)  —  b.  If  we  assign  the  value  of  zero  to  the  imaginary  part,  im  (z)  =  b  =  0,  then 
we  get  a  number  z  =  a  Oi  =  a,  which  is  real.  So  a  real  number  is  a  complex  number  of 
the  form  z  =  a  +  Oi,  and  it  follows  that  the  real  numbers  are  a  special  subset  of  the  complex 
numbers,  i.e., 


R  —  {a  +  bi  \  b  =  0}  c  C. 


A  complex  number  can  be  associated  with  a  vector  I  f 

b 


in  R^.  Just  as  with  vectors,  com¬ 


plex  numbers  are  equal  if  and  only  if  the  real  parts  are  equal  and  the  imaginary  parts  are 
equal.  Given  complex  numbers  z  =  a  +  bi  and  w  =  c  +  di,  z  =  w  if  and  only  if  a  =  c  and 


b  =  d.  If  we  think  of  z  as  the  vector 


a 

b 


and  w  as  the  vector 


equal  if  and  only  if  their  components  are  equal. 


c 

d 


,  these  two  vectors  are 


Example  5.8  If  z  —  3  +  2i  and  w  =  3  —  2i,  we  can  see  that  z  ^  w  because  im{z)  =  2, 
and  im{w)  —  —2. 

When  working  with  real  numbers,  we  can  perform  addition,  subtraction,  multipli¬ 
cation  and  division.  We  can  also  perform  these  operations  with  complex  numbers.  For 
addition  and  subtraction  of  complex  numbers,  we  will  associate  the  operations  with  vec¬ 
tor  addition  and  vector  subtraction.  For  multiplication  we  will  treat  complex  numbers  as 
polynomials  and  for  division  we  must  first  define  the  inverse  of  a  complex  number. 

1.  Addition  and  Subtraction  of  Complex  Numbers 

Recall  that  a  complex  number  has  two  parts,  the  real  part  and  the  imaginary  part. 
When  we  add  and  subtract  complex  numbers  we  want  to  add  and  subtract  component-wise, 
just  as^  we  do  with  vectors.  This  means  add  the  real  part  of  the  complex  numbers  to  the 
real  part  and  add  the  imaginary  part  to  the  imaginary  part.  Given  two  complex  numbers 
z  —  a  -\-  bi  and  w  —  c  -\-  di,  we  get: 

z w  =  {a -\- c) {b^d)i, 
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and 


z  —  w  =  (a  ~  c)  +  {b  —  d)i. 

Example  5.9  Let  z  =  3  +  2i  and  w  =  4  -  7i.  Then 

z  +  w  —  1  —  hi 
w  +  z  =  7  —  hi 
z  —  w  =  —l-\-^i 
ly  —  z  =  1  —  9i. 

In  the  example  we  see  an  illustration  of  the  fact  that  while  addition  of  complex 
numbers  is  commutative,  subtraction  is  not. 

2.  Multiplication  of  Complex  Numbers 

Multiplication  of  complex  numbers  is  not  done  component-wise.  Instead,  we  treat 
multiplication  of  complex  numbers  like  multiplication  of  binomials.  Each  component  of 
the  first  complex  number  is  multiplied  by  each  component  of  the  second  complex  number. 
The  important  fact  to  remember  when  multiplying  complex  numbers  is  that  =  —  1 .  Griven 
two  complex  numbers  z  =  a  +  bi  and  w  —  c-\-di, 

z  ■  w  =  (a  -1-  6z)  (c  -1-  di) 

—  ac  -f  adi  -f  bci  +  bdi^ 

=  ac  +  adi  +  bci  —  bd 
=  (ac  —  bd)  +  (ad  +  be)  i. 

real  part  imaginary  part 

Example  5.10  Let  z  =  3  -I-  2?  and  it;  =  4  -  7i  Then 

z-w={3  +  2i)(4-  7i)  =  12  -  21i  -|-  -  Ui^  =  12-  ISi  +  14  =  26  -  13i 

, ,  Multiplication  of  complex  numbers,  like  addition,  is  commutative. 

3.  Division  of  Complex  Numbers 

Division  of  complex  numbers  requires  that  we  first  acquire  new  tools.  Complex 
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numbers  come  in  pairs,  in  the  sense  that  every  complex  number  2;  has  a  complex  conjugate 
associated  with  it.  If  ^  =  a  +  hi,  we  denote  the  conjugate  of  z  by  putting  a  bar  over 
the  number  2  or  a  4-  bi.  The  complex  conjugate  is  obtained  by  reversing  the  sign  of  the 
imaginary  part  so  that  im{z)  =  -im{z).  The  real  parts  do  not  change;  re{z)  =  re{z). 

z  =  a-\-bi  =  a  —  bi. 

Example  5.11  Find  the  complex  conjugates  of  3  +  4i  and  -6  -  2i. 

3  +  =  3  —  4i, 

-6-2i  =  -6  +  2i. 

If  we  multiply  a  nonzero  complex  number  by  its  conjugate,  we  get  a  real,  nonzero 
number,  i.e.. 


22  —  (a  +  bi)[a  —  bi)  =  4-  abi  —  abi  —  b'^i^  =  5^. 

Using  this  fact  we  can  define  the  magnitude  of  a  complex  number  2,  denoted  |2| ,  as 


This  is  sometimes  called  the  modulus  of  z. 

Example  5.12  Find  the  magnitude  of  2  =  3  +  2i 

|3  +  2i\  =  V(3  +  2i)(3-2i)  =  =  Vis. 

Let  2  be  a  real  number  2  =  u  -t-  Oi.  Then,  |2|  =  V -f"  0^  =  V o/^  —  |(i|.  So  the  ab¬ 
solute  value  of  a  real  number  is  a  special  case  of  the  magnitude  of  2.  Some  other  properties 
of  complex  numbers  are: 

1 .  2  =  2  if  and  only  z  e  R. 

2.  m  2  =  ti;  +  2. 

3.  wz  =  w  ■  z. 

4.  22  =  \zf . 

5.  \wz\  =  lu;!  \z\ . 
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6.  |tt;  +  2:|  <  |t(;|  +  \z\ . 

To  define  division  of  complex  numbers  we  need  the  multiplicative  inverse  of  a  com¬ 
plex  number.  If  z  ^  0,  then  z  has  a  multiplicative  inverse  which  we  define  as  follows: 

_i  _  1  _  ^  _  z 

z  zz  \zf' 

We  can  use  this  multiplicative  inverse  to  perform  division  of  complex  numbers.  Let  w,zhe 
two  complex  numbers,  z  ^0.  Then 

W  _1  ^  wz- 

—  =  w  ■  z  =  w—  = 

2:  ZZ  ZZ 

(We  are  multiplying  7  by  1,  where  1  =  f  ) 

Example  5.13  Let  w  =  3  +  2i  and  z  =  4  —  2i.  Calculate  zz,  |z| ,  and  7. 

zz  =  (4  -  2i)(4  -1-  2i)  =  16  -  4z^  =  16  -I-  4  =  20. 

|2;|  =  Va2  -I-  62  =  ^42  +  (-2)2  =  VI6  +  4  =  VW. 

w  _  wz  _  (3  +  2i){4:  +  2i)  _  12  +  Ui  +  4:i^  8  +  Ui_2  7  . 

z  ^  zz  ~  {4-2i)(4  +  2i)  ~  20  ~  20  “  5  ^  io*' 

C.  THE  COMPLEX  PLANE 

We  can  plot  a  complex  number  as  a  point  on  the  complex  plane  in  the  same  way  that 
we  plot  a  vector  in  R?  as  a  point  on  the  cartesian  plane,  see  figure  12.  The  complex  plane 
looks  like  the  cartesian  plane  except  the  horizontal  axis  is  called  the  real  axis,  representing 
real  numbers  of  the  form  (a,  0) ,  and  the  vertical  axis  is  called  the  imaginary  axis  representing 
imaginary  numbers  of  the  form  (0,6).  We  then  plot  the  complex  number  o -h  6i  as-the  point 
with  cartesian  coordinates  (a,  6)  on  the  complex  plane.  The  point  (a,  6)  may  then  be  labeled 
a  4-  hi.  Recall  that  we  found  that  a  real  number  is  a  special  case  of  a  complex  number 
z  =  hi,  where  6  =  0.  If  we  plot  the  real  numbers  we  see  that  real  numbers  are  ordered. 
Given  two  real  numbers  u,w  E  R,  either  u  <  w,  u  >  w,  or  u  =  w.  Complex  numbers 
cannot  be  so  ordered. 

When  we  plot  a  complex  number  z  =  a  + hi  and  its  conjugate  z  =  a  —  6i  on  the 
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Figure  12.  The  Complex  Plane 

complex  plane,  we  see  that  the  complex  conjugate  is  a  reflection  of  the  original  complex 
number  across  the  real  axis  (horizontal  axis),  see  figure  13.  We  can  calculate  the  distance 
from  the  origin  to  the  point  representing  the  complex  number  by  computing  the  magnitude 
of  the  vector  from  the  origin  to  the  point  representing  the  complex  number.  We  already 
know  the  formula.  Let  z  =  a  +  bi.  The  distance  from  the  origin  to  the  point  z  is 

\z\  =  Vzi  =  +  6^ 

The  geometric  interpretation  of  complex  addition  and  subtraction  in  the  complex  plane  is 
completed  in  the  same  way  that  we  add  vectors  in  the  real  plane  using  the  parallelogram 
rule.  Let  z  =  a-{-bi  and  w  =  c-\-di.  Then  z  +  w  is  the  point  in  the  complex  plane  which  is 
the  4th  vertex  of  a  parallelogram  formed  by  the  origin,  z, and  z  +  w,  see  figure  14.  The 
geometric  interpretation  of  complex  multiplication  in  the  complex  plane  requires  that  we 
take  a  side  trip  and  learn  how  to  represent  a  point  in  a  plane  using  a  new  coordinate  system. 

In  example  5.14  we  locate  the  point  z  in  the  plane  by  beginning  at  the  origin  and 
projecting  a  ray  from  the  origin  along  the  positive  real  axis.  This  is  called  an  initial  ray.  The 
initial  cay  has  angle  0  =  0°.  We  next  project  a  second  ray  from  the  origin  in  the  direction  of 
the  vector.  A  point  z  with  cartesian  coordinates  (a,  6)  can  also  be  represented  polar 
coordinates  (r,  0),  where  r  is  the  distance  from  the  origin  to  z  and  9  is  the  angle  between  the 
positive  real  axis  and  the  vector  representing  z.  By  definition  of  modulus,  we  have  r  =  |z|. 
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Figure  13.  Complex  Conjugate 
We  call  9  the  argument  of  denoted  arg  {z) . 

r  1 

Example  5.14  Let  z  =  1  +  i.  In  the  complex  plane,  z  is  represented  by  the  vector  ^ 

which  has  cartesian  coordinates  (1, 1),  see  figure  15.  We  can  also  represent  the  point  z  by 
the  coordinate  (a/2,  where  Vz  is  the  distance  from  the  origin  to  the  point  z  and  |  is  the 
angle  from  the  positive  real  axis  to  the  vector  representing  the  complex  number. 

To  find  9,  we  first  need  to  define  some  basic  concepts. 

1.  0  is  positive  when  measured  counterclockwise  from  the  positive  real  axis,  and  nega¬ 
tive  when  measured  clockwise  from  the  positive  real  axis. 

2.  9  is  not  unique.  The  angle  |  is  the  same  angle  as  ^  which  is  the  same  angle  as  In 
general,  any  angle  9  is  the  same  as  the  angle  9  +  2k'K,  where  k  is  any  integer.  So,  if  z  0, 
then  arg  (z)  takes  on  infinitely  many  values.. 

We  use  these  concepts  to  further  define  what  we  mean  by  arg(z) .  The  argument  of  z  can  be 
viewed  as  the  set  of  all  arguments  of  z,  a  set  containing  infinitely  many  elements. 

arg  (z)  =  ^  -I-  2k7r,  k  any  integer. 

Tht  principal  argument  is  the  single  argument  of  z  that  is  in  the  range  -tt  <  6>  <  tt. 
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Figure  14.  Addition  of  Complex  Numbers 

Just  as  the  complex  number  z  has  cartesian  coordinates  and  a  representation  in  carte¬ 
sian  form,  the  same  complex  number  has  polar  coordinates  and  a  representation  in  polar 
form.  Consider  the  complex  number  z  =  a-\-hi.\n  the  complex  plane,  z  is  the  point  (a,  b) . 
z  can  also  be  written  as  the  point  (r,  0) .  Since  6  is  the  angle  between  the  positive  real  axis 
and  the  directed  line  segment  from  the  origin  to  the  point  (a,  b)  and  r  is  the  magnitude  of  that 
directed  line  segment,  r  =  \z\  =  VoM^,  from  basic  trigonometry  we  have  cos6>  =  ^, 
and  sin  0  f .  We  can  then  write  o  =  r  cos  and  b  =  r  sin  d.  If  we  substitute  these  values 
for  a  and  b  into  a-\-bi,  we  obtain: 

a-\-bi  =  {r  cos  6)  +  (r  sin  6)  i. 

Factor  out  an  r  and  we  obtain: 

a  +  bi  =  r  (cos  ^  i  sin  0) 

So,  we  can  change  from  cartesian  form  to  polar  form  and  vice  versa  for  ^  using  the  following 
formulas: 

a  =  rcos6,  b  =  rsm0,  r  =  tan9  =  -, 

which  gives  us:  ^ 

cartesian  coordinates:  (a,  b)  cartesian  form:  a  +  bi 
polar  coordinates:  (r,  6)  polar  form:  r  (cos  0  +  z  sin  6) 
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Figure  15.  Polar  Coordinates 

Given  a  complex  number  2  =  a  +  the  polar  form  of  the  equation  for  2:  is 

a-\-hi  =  r  cos  0  +  ir  sin  9 
=  r  (cos  9  +  i  sin  9) 

=  |2:|  (cos 0  +  isin0) 

The  most  common  mistake  made  in  converting  from  the  cartesian  to  the  polar  form  of  the 
equation  is  the  miscalculation  of  the  argument  9.  When  calculating  9  we  must  make  sure  that 
we  locate  the  argument  in  the  correct  quadrant  of  the  plane.  A  mistake  can  occur  when  we 
calculate  9  using  the  formula  tan  ^  but  we  do  not  verify  that  the  solution  is  consistent 
with  the  complex  number  2:. 


Example  5.15  Consider  the  two  complex  numbers,  2:  =  and  w  —  — 

see  figure  16.  When  we  plot  the  points  representing  2:  and  w,  we  find  that  2;  is  in  the  fourth 
quadrant  of  the  complex  plane  with  argument  9  =  while  w  is  in  the  second  quadrant  of 
the  complex  plane  with  argument  0  =  ^.  If  we  do  not  think  about  the  physical  placement 
of  the  angles  in  the  plane,  and  use  only  the  formula,  we  find  that 
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Figure  \6.  z  ^  and  w  =■ 

If  we  are  not  conscious  of  the  quadrant  we  want,  we  could  erroneously  choose 


arg(z)  =  arg(iy)  = 
or 

arg(z)  =  arg(u;)  = 
or  switch  the  arguments  altogether. 


Now  we  return  to  multiplication  of  complex  numbers  using  polar  coordinates.  Given 
two  complex  numbers  2:  =  a+6i  -  \z\  (cos  6 +  ism  6)  and  w  =  c-^di  =  |tt;  |  (cos  0  +  z  sin  <j>) 
we  calculate  zw  using  the  “foil”  method  as  follows; 

zw  =  [1^1  (cos  0  +  i  sin0)]  •  [|ry|  (cos  (^  +  i  sin(^)] 

=  ]\z\  cos  0  +  1^1  *  sin  0\  •  [|u;|  cos  (f>  +  |u;|  isin^] 

1^1  1^1  ^  •^os  (f)  +  \z\  |rc|  cos  6i  sin  (p  +  \z\  |to|  cos  <pi  sin  6  +  ^z\  jiyl  i  sin  6i  sin  (p 
\^l  i^l  ^  4’  “h  I'u^l  cos  6i  sin  p  +  \z\  |rt;[  cos  pi  sin  6  +  \z\  liol  sin  9  sin  p 

^  3 

Factor  out  |2r|  \w\  and  regroup  the  equation  into  re  (zw)  and  im  (zw) ,  remembering  that 
=  -1; 


\z\  |u;|  [(cos  6cosp-  sin  6  sin  p)  +  i  (cos  ^  sin  (^  +  cos  p  sin  0)] . 
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Using  trigonometric  identities  we  get  the  final  form, 


zw  =  \z\  |r/;|  [cos  {6  +  (p)  +  i  sin  (6*  +  4)] . 

To  put  this  in  words,  the  magnitude  of  the  product  zw  is  equal  to  the  product  of  the  magnitude 
of  2:  with  the  magnitude  of  w,  and  the  argument  of  the  product  zw  is  equal  to  the  sum  of  the 
argument  of  2;  with  the  argument  of  w. 


Example  5.16  Let  z  =  l+i  and  let  w  =  Ai. 

Convert  2:  and  w  to  polar  form.  Then,  compute  zw  in  both  cartesian  and  polar  form. 

Solution: 

First  we  calculate  the  magnitudes  of  2:  and  w 

\z\  =  =  V2, 

|t(;|  =  =  VO^  +  4^  =  \/l6  =  4. 

Now  we  compute  the  argument  for  z: 


6  =  tan  ^  — 
a 

_i  1 

=  tan  - 
=  tan“^  1. 

Our  choices  are  9  =  orO  =  Since  z  is  in  the  first  quadrant  we  want  9  =  arg  (z)  = 

Thus  the  polar  equation  for  z  is 


z  = 


TT 

COS  —  +  i  Sin 

4 


Now  compute  the  argument  for  w: 


4 


-1  b 
tan  - 
a 

_i  4 
tan-  5. 


which  is  undefined.  Our  choices  are  4  =  4  —  Since  w  is  a  positive  pure  imaginary 

number,  we  want  4  —  arg  {w)  =  |.  So  the  polar  equation  for  w  is 


w  =  Al  cos  —  +  ^  sin  — 

V  2  27 
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Finally,  we  can  compute  zw.  In  cartesian  form  we  get 

zw  —  (1  +  i)  (0  +  4i) 

=  0  +  +  0  + 

=  -4  +  Ai. 

In  polar  form  we  use  the  formula  we  developed  for  multiplication  using  polar  coordinates, 
to  obtain 

zw  =  V^^cos— +isin^^  •  4  ^cos^  4-isin^^ 

=  1^1  |tt;|  [cos  {9  A-  4>)  A-i  sin  [9  +  (p)] 

=  v^.4(cos(j  +  |)+isin(j  +  |)) 

Note  that  if  we  evaluate  the  sine  and  cosine  we  obtain 

zw  =  V2-4(=^+i^^ 

=  2(-2)+i2(2) 

=  -4  +  4i, 

which  is  the  cartesian  form  of  2  +  w  as  computed  above. 

Suppose  we  let  w  =  z.  Then  when  we  compute  zw,  we  are  actually  computing 
=  z^.  If  we  multiply  the  result  z^  with  2:,  we  are  actually  computing  z^.  We  can  continue 
in  this  manner  to  compute  2;".  Once  we  know  how  to  multiply  complex  numbers  using  their 
polar  form,  we  can  compute  powers  of  complex  numbers. 

Let  z  =  r  (cos  9  A-  i  sin  9) .  Then 

=  2:^  =  rr  (cos  (^  +  0)  +  isin  (0  +  0)) 

=  (cos  29  A- i  sin  29) . 

Let’s  try  another  step. 

2:^2;  =  z^  =  r^r  (cos  (26>  A-9)A-i  sin  {29  +  9)) 


147 


=  (cos  W  -\-i  sin  30) . 

This  process  continues  and  yields  a  general  formula  known  as  DeMoivre  ’s  Theorem,  which 
states  that  if  z  =  r  (cos  0  +  i  sin  0),  then 

2;”  =  r”  (cos  n0  +  i  sin  n0)  n  =  l,2,... 

Ifwe  define  2®  =  land^;’"  =  then,  for  all  integers  n  =  0,  ±1,  ±2,  ...,DeMoivre’s  The¬ 
orem  will  apply.  Remember  when  we  have  the  formula  we  are  working  with  complex 
division. 

Example 5.17  Let z  —  Compute z'^. 


Solution: 

Using  DeMoivre’s  theorem,  we  get  z'^  =  (cos  40  -f  i  sin  40) .  We  already  know 

the  values  for  r  and  0  from  the  previous  example: 

=  (V2)  (cos4(0-h*sin4(|)) 

=  4  (cos  TT  +  i  sin  tt) 

=  -4. 

If  we  can  compute  powers  of  complex  numbers,  it  would  seem  logical  that  we  can 
compute  roots  of  complex  numbers.  Consider  z^  where  n  is  a  positive  integer.  We  call  z^ 
the  nth  root  of  2:.  We  will  use  DeMoivre’s  theorem  to  develop  a  formula  for  the  nth  roots  of 
a  complex  number. 


Let  w  =  z^.  This  means  2:  =  w”.  Now  write  2:  and  w  in  polar  form: 


z  =  r  (cos  0  -f  i  sin  0) , 


and 


w  =  p  (cos  (p  +  i  sin  (/)) . 

We  also  know  how  to  write  n;”  using  DeMoivre’s  Theorem: 


w'^  =  p'^  (cos  n(j)  -\-i  sin  n^) . 
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We  know  that  z  =  uf^.  In  polar  form,  we  have 


r  (cos 6  +  ism9)  =  p”  (cos n(j)  +  i sin ncf)) . 


Now  we  equate  the  magnitudes,  obtaining  r  =  p”,  and  it  follows  that  p  =  rn.  Since  r  is 
the  magnitude  of  2;,  r  >  0.  Therefore,  p  is  the  nonnegative  nth  root  of  r.  Now  equate  the 
arguments,  obtaining 

6  =  n(f). 

Recall,  that  9  is  not  unique.  Any  angle  9  is  equal  to  the  angle  9  +  2k'K,  for  any  integer  k. 
So  if  k  is  an  integer,  we  have 

ncj)  =  9  +  2k'K 


or 

9  +  2kTT 

<p= - 

n 

We  now  rewrite  w  using  these  values  for  p  and  cf) : 


w  =  p  (cos  +  i  sin  (p) 

if  9  +  2k'K  .  .  9  +  2A:7r 


rn  cos 


+ 1  sin 


We  began  with  the  assumption 


This  means 


W  —  Z”. 


1  if  9  +  2k7r  .  .  9  +  2k7T\ 
w  =  Z'^  =  rn  (  cos - h  z  sin - 

\  n  J 

Let’s  change  the  format  of  the  above  equation  to: 

i  1  /  1  /  1 

(  cos  -  (0  +  2A:7r)  +  i  sin  -  (0  +  2A:7r) 


When  we  let  k  =  0, 1,  ...,n  —  1,  we  get  exactly  n  distinct  values  of  z^.  These  n  distinct 
values  are  the  nth  roots  of  the  complex  number  z.  Notice  that  the  n  distinct  roots  are  also 
complpx  numbers.  What  happens  if  we  let  k  >  n?  The  result  will  be  a  repeated  root.  Let’s 
look  a  little  closer  at  the  equation, 

zn  =rn  (^cos-(^  +  2A:7r)  +  ^sin-(0  +  2A;7r))  ,  k  =0,l,...,n-l 
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If  we  let  m  =  ^  and  6  —  9  +  2k7i,  then  we  can  write 


This  is  DeMoivre’s  formula.  The  formula  for  finding  the  roots  of  a  complex  number  is 
summarized  in  the  following  theorem.  [Ref.  2] 

Theorem  5.4  Every  nonzero  complex  number  z  =  r  (cos  ^  +  z  sin  9)  has  n  distinct  nth 
roots  for  any  positive  integer  n.  Each  root  has  magnitude  r«  and  the  arguments  are  the 
angles  for  A:  =  0, 1,  ...n  —  1. 

Theorem  5.4says  that  a  complex  number  z  has  n  distinct  nth  roots  for  any  positive 
integer  n.  This  means  a  complex  number  z  has  two  square  roots,  three  cube  roots,  four 
fourth  roots, ...,  n  nth  roots.  Let’s  do  an  example. 

Example  5.18  Let  z  =  1  +  Oi  Find  the  formula  for  the  nth  roots  of  z. 


We  want  the  equation. 


zn  =  rn  ^cos  —  (9  +  2A:7r)  +  i  sin  —  (^  +  2A:7r)^  . 

Begin  by  finding  r: 

r  —  \z\  =  a/p  +  0^  =  1. 

Now  find  the  principal  argument  9: 

9  =  tan“^  — 
a 

-1  0 
=  tan  — 
a 

=  tan“^  0. 

We  have  two  choices  for  9, 9  =  0  or  9  =  tt.  Since  z  is  a  positive  pure  real  number,  we  want 
^  =  0.  Substituting  1, 0  for  r,  9,  respectively,  we  have 


Z”-  =  r"  ^cos  “  (^  +  2A;7r)  +  i  sin  —  (9  +  2k7r)J 

=  ^cos  ~  (0  +  2A:7r)  +  i  sin  —  (0  +  2kTT)^ 
f  2k'K  2k'K\ 

=  cos - l-isin -  ,  A:  =  0,1,2,  ...,n  -  1. 

V  n  n  / 


This  will  give  us  n  nth  roots  of  1.  These  are  also  known  as  ,  the  nth  roots  of  unity.  Let’s 
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use  this  formula  to  find  the  five  fifth  roots  of  2:.  Setting  n  =  5, 


1  /  2k'K  .  ,  2kn\ 

Z5  =  (  cos— g — A:  =  0,1, 2, 3, 4, 


we  obtain  the  formula  for  the  five  fifth  roots  of  z.  Evaluate  for  each  k. 


For  A:  =  0,  this  takes  on  the  value 


2  (0)  TT  2  (0)  TT 

COS  — - - h  %  sin  — V — 

5  5 


cosO  +  i  sinO  =  1. 


For  A:  =  1 ,  this  takes  on  the  value 


2(l)7r  .  .  2(l)7r\  27r  .  .  27r 

cos  — - h  ^  sm  — - —  )  =  cos  —  +  t  sm  —  «  0.309  +  0.951i. 

5  5/5  5 


For  A:  =  2,  this  takes  on  the  value 


2(2)7r  .  ,  2(2)7r\  A-k  Att 

cos  — - h  ^  sm  — - —  )  =  cos  —  +  i  sin  —  «  —0.809  +  0.588i. 

5  5/5  5 


For  k  =  3,  this  takes  on  the  value 


2  (3)  TT  .  .  2(3)'k\  Gtt  Gtt 

cos  — - h  i  sm  — - —  )  =  cos  —  +  z  sin  —  pa  —0.809  —  0.588i. 

5  5/5  5 


For  A:  =  4,  this  takes  on  the  value 


2  (4)  TT  .  .  2  (4)  TT  \  87r  .  Stt 

cos  — - - h  t  sm  — - —  )  =  cos  —  +  z  sm  —  «  0.309  —  0.951z. 

5  5/5  5 


Just  for  fun,  let’s  compute  the  root  for  A:  =  5, 


2(5)7r  .  .  2(5)7r 

cos  — - - 1-  z  sm  ■ 

5  5 


IOtt  ,  .  IOtt 
cos  — — h  z  sm  — — 
5  5 

cos  27r  +  z  sin  27r 
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This  is  the  same  root  that  we  got  when  we  let  A;  =  0,  a  repeated  root  as  stated  earlier. 

If  we  plot  each  root  we  will  produce  figure  17.  We  see  that  the  five  roots  are  the  ver- 


Figure  17.  5th  Roots  of  the  Unity 

tices  of  a  regular  polygon  of  5  sides  inscribed  in  the  unit  circle  around  the  origin,  with  one 
vertex  located  at  (1, 0) . 

It  turns  out  that  for  any  complex  number  the  kth  roots  of  z  are  equally  spaced 
around  a  circle  of  radius  ^^/\z\  centered  about  the  origin. 

Example  5.19  l.txz  =  l-i.  Find  the  fourth  roots  of  2;. 

Begin  by  finding  the  magnitude  of  z 

1^1  =  +  (-!)'*  =  ^/2. 

Now  find  the  principal  argument  9  for  2:. 

0  =  tan“^  - 
a 

=  tan"^  — 

1 

=  tan~^  —1. 

.c  .3 

The  ^o  choices  for  0  are  0  ^  and  0  f .  Since  z  is  in  the  fourth  quadrant,  we  want 

9  =  -f-.  Now  substitute  into  the  formula 

z*  =  ^cos  ~^{9  +  2kTr)  +  i  sin  ^  (0  +  2A;7r)^ 
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+  ^  A:  =  0,1, 2, 3. 


4/  V  4 


For  A:  =  0,  this  takes  on  the  value 


2i  cos(^^j+isin(^^^ 

r.i  ~'^  ■  •  ~7r 

=  28  cos  — —  +  ^  sin - 

16  16 


For  A;  =  1 ,  this  takes  on  the  value 


24  [cos  +  ,3i„ 

r.i  r  77r  .  .  Ttt 

=  28  cos  —  +  ^  sm  — 
16  16 


For  A:  =  2,  this  takes  on  the  value 


28  cos 


-7r/4  +  47r 


+  isin 


-7r/4  +  47r 
4 


-1  IStt  ,  .  IStt 
28  cos— +  ^sm•— 
16  16 


For  A;  =  3,  this  takes  on  the  value 


r  /— 7r/4  +  67r\  .  .  /— 7r/4  +  67r^ 

28  cos  — -  +  ^ sin  - - 

L  V  4  ;  \  4  J 

r  237r  .  .  237r 

=  28  cos— — +  ^sln - 

16  16 


If  we  plot  these  values,  they  will  be  the  vertices  of  a  polygon  with  4  sides  centered  around 
the  origin,  inscribed  in  a  circle  of  radius  21. 


Before  leaving  our  study  of  complex  numbers,  we  want  to  consider  one  more  use  of 
complex  numbers  in  the  exponential  function  e®. 
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D.  COMPLEX  EXPONENTIAL  FUNCTION 

A  well  known  result  in  calculus  is  the  ability  to  compute  the  exact  value  of  the 
functions  e®,  sin  x  and  cos  x  using  the  formulas: 

e  =i+^  +  ^  +  ---  +  ^-  =  E;7r'  (VS) 


x^  x^ 

smx  =  X - pH - ...j_  f— Ip - 

3!  ^  51  '  (2n  +  l)! 


=  E 


S  (2r.  +  l)!  ■ 


cosx  =  1 - pH - *••  +  (—1)’^ - -  ••  =  ^ _  fVS'i 

2!  4!  ^ ’  {2n)\  ^  (2n)!  '  ^  ^ 

We  want  to  define  e®,  where  a;  is  a  complex  number  a  +  bi.  We  have  the  following 


cosa;  =  l - -  + - +  f-D”  — — 

2!  4!  ^ ’  {2n)\ 


rule  of  exponents; 


This  means  we  can  write 


ga+6  ^ 


ga+6i  ^ 


We  can  compute  e“  using  the  formula  V6: 


a  ^ 

^  ='+“+2!  +  3! 


But  we  do  not  have  a  rule  for  complex  exponents,  so  how  do  we  represent  e*’"?  Begin  by 
using  the  formula  V6. 


2!  4!  6! 


3!  5! 


2!^4! 

=  cds  (6)  +  i  sin  (6) , 
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which  means  we  can  write 


icos  (6)  +  i  sin  (6)] . 


This  is  known  as  Euler  ’ s  formula .  Notice  that  this  is  a  polar  form  for  e®"*"*”  where  the 
magnitude  of  is  e^.  Euler 's  identity  is  a  result  of  Euler’s  formula  when  a  =  0. 


e*®  =  cos  ^  i  sin  9. 


What  happens  if  we  have  e  Using  Euler’s  identity  and  the  facts  that: 


and 


we  can  write 


cos  {—9)  =  cos9 , 
sin  (—6*)  =  —  sin0, 

cos^  9  +  sin^  9  =  1, 


e  *^  =  cos  (— 0)  +  isin  (— 0) 
=  cos  0  —  i  sin  9. 


We  also  know  that 


e 


-w 


Remember,  this  is  complex  division: 


Qte 

1 

cos  9  +  i  sin  9 


1 

cos  9  -\-i  sin  9 


1 

cos  9  +  i  sin  9 


cos  9  —  i  sin  9 
cos  9  —  i  sin  9 


cos  9  —  i  sin  9 
cos^  9  4-  sin^  9 


=  cos  9  —  i  sin  9. 


155 


We  can  conclude  that 


e  =  cos  9  —  i  sin  9. 

Example  5.20  Given  e^\  we  write  the  cartesian  form  (a  +  bi) : 

Solution: 


giri  _  gO  j-g^g  _|_  ^  gj^ 

=  1  [-1  +  0]  ■ 

Example  5.21  Given  write  the  cartesian  form  (a  +  bi)  : 

Solution: 


g2  3t  _  g2  j-gg^g  _|_  ^  gjjj  (  —  3)] 

=  [cos  (3)  —  i  sin  (3)] . 

Example  5.22  Given  write  the  cartesian  form: 

Solution: 


g4+f  i 


=  e‘[cos(|)+isin(|)] 


e  [0  +  i] 
=  ie^. 


Exam  pie  5.23  Given  e  4 + 1  write  the  cartesian  form : 

Solution: 


e“+^^  =  e“  [cos  (6) +  i  sin  (6)] 

2L 

e4 


I  j-ij 
64  +  4* 


TT  .  TT 
COS  —  +  ^  sm  —  , 

4  4J 


=  64 


2  2 


\/2  W  .  \/2  TT 

Example  5.24  Given  write  in  cartesian  form. 
Solution: 


g2  2i  _  g2  jgg^g  -|-  i  gin  (—2)] 

=  [cos  (2)  —  i  sin  (2)] 
=  cos  (2)  —  ie^  sin  (2) . 
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This  gives  us  a  new  way  to  write  the  polar  form  of  2;. 


2  =  a hi 

=  |2|  [cos0  +  isin0] 


Euler’s  idenity 


=  \z\e 


ie 


=  re 

Example  5.25  Given  2  =  3i,  write  the  polar  form  using  the  exponential  function. 
First  we  find  \z\  : 

b|  =  =  3. 


2  =  I2I  [cos  9  +  i  sin 9] 
—  3  [cos  9  +  i  sin  9] . 


Then  we  find  arg  (2); 


tan  ^  Q)  undefined 
Finally  we  substitute  into  the  polar  equation: 


2  =  3 


7r  .  .  TT 
cos  —  +  *  sin  —  , 

2  2J 


=  3e2* 

Example  5.26  Given  2  =  1  -  write  the  polar  form  using  the  exponential  function. 
Find  I2I . 

kl  =  \/l2  +  H)^  =  \/2. 

1  —  i  =  y/2  [cos  9  -\-i  sin  9] 

/X  [  ■  .  “TT 

=  V  2  cos  — — h  i  sm 

4  4 

=  \/2e^* 

We  conclude  this  section  with  properties  of  the  complex  exponential  function. 
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Properties  of  the  complex  exponential  function 


Given  complex  number  z  =  a  +  bi  and  w  -  c  +  di. 

1.  e^e'^  =  6^+'^. 

2.  7^  0,  for  all  z. 

3.  for  all  2;. 

A  ^ 

•  ^ 

5.  If  6  is  real,  |e^*|  =  1. 

E.  COMPLEX  EIGENmLUES  AND  EIGENVECTORS 

We  study  complex  eigenvalues  to  uncover  “hidden”  information  about  matrices  with 
real  entries  that  arise  in  real  life  problems  such  as  motion,  vibration,  and  rotation  in  space. 
The  methods  we  learned  for  finding  real  eigenvalues  and  eigenvectors  apply  to  finding 
complex  eigenvalues  and  eigenvectors.  Let’s  begin  with  an  example. 


Example  5.27  Let  A  = 
A. 


2  -1 

1  2 


.  Find  all  eigenvalues  and  associated  eigenvectors  for 


Solution: 

We  first  solve  the  characteristic  equation 

det  [A  —  \i)  - 
2- A  -1 
1  2-  A  ' 

A^-4A  +  5  = 

=  4±^ 

2 

A  =  2  it 

The  eigenvalues  for  the  matrix  A  are  Ai  =  2  +  i  and  A2  =  2  -  i. 

Now  we  find  the  eigenvectors  associated  with  each  eigenvalue,  by  solving  the  correspond¬ 
ing  homogeneous  system. 


0 

0 

0 
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For  Ai  =  2  +  we  have: 


{A  —  Xil)x  =  0 

■2-(2  +  i)  -1 

1  2  -  (2  +  i) 

Write  the  augmented  matrix: 

■  -i  -1  0  ‘ 

[1  -i  0  • 

Add  —i  times  row  1  to  row  2: 

'  -i  -1  O' 

[  0  0  0' 

This  gives  us  the  equation, 

—ixi  —  X2  =  0. 

Let  X2  be  the  independent  variable.  Then  we  get 

—ixi  =  X2,  or 

Xi  =  iX2. 

The  eigenvector  is 


Xj 

■  0  ■ 

X2 

0 

X 


X2  ^  0. 


The  parametrized  solution  is 

r  i 

X  —  s  ^ 

We  can  check  our  solution  by  choosing  s  =  1  : 


Ax  =  \x 

2  -1 
1  2 


2«  —  1 

'  2i-l' 

i  T  2 

i  2 

Therefore,  Ai  =  « is  an  eigenvalue  for  the  matrix 

x  =  s  ^  ,  S  /  0. 

For  A  =  2  —  i,we  have 


A  with  associated  eigenvector 


{A  —  XI)  X  =  0 
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- , 

bO 

1 

1 

0  -1  1 

■  Xi  ' 

■  0  ■ 

1 

2 -{2-i) 

X2 

0 

Write  the  augmented  matrix: 

■  i  -1 

0  ■ 

1  i 

0 

Add  i  times  row  1  to  row  2: 

■  i  -1 

0  ■ 

0  0 

0 

This  gives  us  the  equation, 

ixi  —  X2 

=  0 

Let  X2  be  the  independent  variable.  Then  we  get: 


The  eigenvector  is 


X 


ixi  =  X2,  or 

Xi  —  —1X2- 


-tX2 


=  X2 


—I 


)  X2  ^  0. 


The  parametrized  solution  is 


X  =  t 


—t 

1 


t  ^  0. 


We  can  check  our  solution  by  choosing  t  =  1  : 


■  2  -1  ■ 

1  2 

Ax  = 
-i 


=  2-i 


—% 

1 


-2i-\ 
— i  “h  2 


-2i-\ 
— i  “t“  2 


Therefore,  A2  =  2  —  i  is  an  eigenvalue  for  the  matrix  A  with  associated  eigenvector 
^  =  .1,  t  ^  0. 


We  can  see  a  special  feature  of  complex  eigenvalues  in  our  example. 


Ai  —  2  “h  ij 

A2  —  2  —  i,  =  Xi 
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When  the  matrix  A  is  real,  its  complex  eigenvalues  and  complex  eigenvectors  appear  in 
conjugate  pairs. 


F.  EXERCISES 


1.  Find  the  characteristic  polynomial  and  all  eigenvalues  and  associated  eigen¬ 
vectors  for  the  following  matrices. 


2  5 
4 


c) 


3  0  0 

1  0  4 

2  0  1 


d) 


5  10 
0  0  0 
2  0  1 


e) 


-2  2  0 
0  3  0 
2  0  1 


f) 


4  0  0  2 
0  0  0  0 
2  0  0  0 
0  0  0  3 


2.  Is  A  =  2  an  eigenvalue  of 


4  1 
2  3 


? 


3.  Is 


1 

4 


an  eigenvector  of 


6  2 
3  1 


I6I 


4.  Calculate  (5  —  M){2  +  2i). 


5.  Calculate  (1  +  i)  +  (2  +  2i). 

6.  Calculate 

7.  Calculate  (2  +  4i)(3  +  6i). 

8.  Calculate 

9.  Calculate  +  3i^  —  4. 

10.  Calculate|3  +  4i\ . 


11.  Let  z  —  5  —  2i.  Find  \z\ . 

12.  Let  z  =  4  +  4i, 

a)  Find  the  principal  argument  of  z. 

b)  Write  2;  in  polar  form. 

13.  Let  z  =  4i,  let  re  =  2  +  2i. 

a)  Compute  zw  in  rectangular  form  (a  +  hi). 

b)  Write  2:  and  w  in  polar  form. 

c)  Compute  zw  in  polar  form. 

d)  Compute  z^  in  rectangular  form. 

e)  Compute  z^  in  polar  form. 

14.  For  each  complex  number  2;,  compute  |2:|  and  the  principal  argument  of  2;, 
and  write  2r  in  polar  form  (for  some  problems  the  principal  argument  may  involve 

a)  z  =  2  +  4i 
h)z  —  4- i 

c)  2^  =  6  “(■  3i 

15.  Write  2:  in  rectangular  form  (a  +  hi)  where  z  =  2  [cos  (^)  +isin  (^)]  . 
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16.  Find  I64. 

17.  Write  the  exponential  as  a  complex  number  in  cartesian  form  (a  +  bi). 

a) ei+*f 

b) 

18.  Write  2;  in  polar  form  re*®. 

a)  z  =  4i 

b) z  —  1  +  i 

19.  Find  all  square  roots  of  ^ 

20.  Plot  the  six  sixth  roots  of  1. 

21.  Find  all  eigenvalues  and  eigenvectors  of 


22.  Find  all  eigenvalues  and  eigenvectors  of 
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APPENDIX  A.  SOLUTIONS  TO  EXERCISES 


CHAPTER  ONE 

l.a.  Nonlinear,  (Satires) 

l.b.  Linear 

l.c.  Nonlinear, 

l.d.  Linear 

l.e.  Nonlinear,  (— 

l.f.  Linear 

l.g.  Nonlinear,  {A^yz) 

l.h.  Linear 

l.i.  Linear 

l.j.  Nonlinear,  (—3x^) 


Coefficient  Matrix  Augmented  Matrix 


'21  30  O]  [21  30  0  l' 

0  1  -1  3  0  ,  0  1  -1  3  0  -4 

10  50  -2  J  [lO  50-2  6 

Coefficient  Matrix  Augmented  Matrix 


3.a. 


-  2^  +  -  4 

X2  =  s 

Xs  =  t 

X4  =  U. 


s,  t,  u  are  scalars. 
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3.b. 

V 

w 

<  X 

y 

z 

V 

3. C. 

'  X  =  s  —  6t 

<  y  =  s  ,  5,  i  are  scalars. 

2:  =  t 

V 

4. a. 

2x  +  y  =  5 

—3a;  +  2y  =  3. 

Solve  for  y  in  the  first  equation: 

y  =  5  —  2a;. 

Substitute  for  y  in  the  second  equation; 

-3a;  +  2  (5  -  2a:)  =  3 

—3a;  +  10  —  4a;  —  3 

-7x  =  -7 

a;  =  1. 


=  4q  —  r  —  5s  —  St 

=  q 

=  r  ,  q,r,s,t  are  scalars. 

=  s 

=  t. 


Solve  for  y  : 


y  =  5-2(1) 
=  3. 


The  linear  system  has  a  unique  solution 


{ 


X 

y 


1 

3  • 


4.b 


{ 


X 

y 


1 

2  • 
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4.C 

2x  -  Sy  -  z  =  6 

X  +  6y  -  2z  =  1.2 

—x  +  4y  +  &z  =  24. 

Solve  for  x  in  the  first  equation; 

3  1 

x  =  -y  +  -,  +  3. 

Substitute  for  x  in  the  second  and  third  equations: 

(^y  +  ^^  +  s) +62/-22:  =  12 
-  Qy  +^z  +  3^  +4y  +  6z  =  24. 
These  equations  simplify  to: 


15y  —  3z  =  18 
3y  +  llz  =  54. 


Solve  for  y  in  the  second  equation; 


Substitute  into  the  third  equation: 

6(i.  +  5)+iu 

z 


54 

4. 


Back  substitute  to  solve  for  y  : 


y  =  j(4)  + 

y  =  2. 


6 

5 
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Back  substitute  to  solve  for  x  : 


3  1 

=  2»+2"  +  ® 

=  5(2)  +  ^(4)+3 

=  8. 

a;  =  8 

This  linear  system  has  the  unique  solution  ^  y  =  2  . 

z  =  4 


4.d 


Solve  for  X2  in  the  first  equation; 


6x2  ~  6 

4:Xl  +  X2  —  — 3. 


X2  =  1. 


Substitute  for  X2  in  the  second  equation: 


4x\  -f  1  —  — 3 
4x1  =  —4 

Xi  =  — 1. 


This  linear  system  has  the  unique  solution 


{ 


Xi 


-1 

1  • 


4.e. 


-Xi 

+ 

X2 

+ 

3X3  = 

3 

— 2xi 

+ 

X2 

+ 

5X3  = 

0 

— 3xi 

+ 

2X2 

+ 

8x3  = 

3. 

Solve  for  xi  in  the  first  equation: 

Xi  r 

=  X2  +  3x< 

1-3. 

Substitute  into  the  second  and  third  equation; 

-2  (X2  +  3X3  -  3)  +  X2  +  6x3  =  0 
— 3  (x2  +  3x3  —  3)  +  2x2  ”1”  8^3  =  3 


168 


These  equations  simplify  to: 

-X2  -X3  +  6  =  0 
-X2  -X3+6  =  0. 

Solve  for  X2  in  the  second  equation: 

^2  =  -^3  +  6. 

Substitute  into  the  third  equation: 

-  (-X3  +  6)  -  X3  + 6  =  0 

0  =  0. 

This  equation  is  true  for  any  value  assigned  to  X3;  therefore,  X3  is  an  independent  variable. 
Solve  for  Xi  in  terms  of  0:3  : 

Xi  =  — 3^3  -1-  6  +  3x3  —  3 
Xi  —  2iX3  -j-  3. 

This  linear  system  has  infinitely  many  solutions.  The  general  solution  is: 

=  2s  “1“  3 

X2  =  — s  +  6  ,  s  is  a  scalar. 

X3  =  s 

4.f 

— "b  X2  3X3  =  3 

— 2a;i  -\r  X2  +  6x3  =  0 

— 3xi  +  2x2  +  8x3  =  4. 

Solve  for  xi  in  the  first  equation: 

Xi=X2  +  3X3  -  3. 

Jl  J 

Substitute  into  the  second  and  third  equation: 

2  (ai2  "b  3x3  —  3)  "b  X2  +  5x3  =  0 
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3  (^2  33^3  —  3)  +  2X2  'i'  8^3  =  4. 

These  equations  simplify  to: 

— X2  —  iK3  +  6  =  0 

-X2  -  X3  +  5  =  0. 

Solve  for  X2  in  the  second  equation: 

X2  =  — 2:3  +  6. 

Substitute  into  the  third  equation: 

-  (-xs  +  6)  -  3:3  +  5  =  0 
-1  =  0. 

This  equation  is  not  true  for  any  value  assigned  to  X3;  therefore,  this  linear  system  is  incon¬ 
sistent. 


5.a. 

Augmented  Matrix 

2-3-1  6  1  r  2  -3  -1  6  1  r  2  -3  -1  6  ‘ 

1  6  -2  12  ~  0  f  f  9  0  f  ^  9 

-1  4  6  24  j[o  |y27J[0  0  6  24 

Add  -1/2  times  row  1  to  row  2  Add  -1/3  times  row  2  to  row  3  This  is  row  echelon  form. 

Add  1/2  times  row  1  to  row  3 

Write  the  corresponding  linear  system: 

2x  —  Zy  —  z  =  6 

fy  -  f.?  =  9 

6z  =  24. 

Solve  for  ^  in  the  third  equation: 

z  =  4. 

Back  substitute  for  2;  into  the  second  equation: 
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15 


y  =  2. 

Back  substitute  for  y  and  2:  into  the  first  equations; 


2x  —  3y  —  z  =  6 

2a: -3  (2) -4  =  6 

2x  =  16 

a:  =  8. 


This  linear  system  has  a  unique  solution: 


5.b. 


Attgmented  Matrix 


■  -1 

1 

3 

3  ■ 

■  -1 

1 

3 

3  ■ 

■  -1 

1 

3 

3  ■ 

-2 

1 

5 

0 

0 

-1 

-1 

-6 

r'w/ 

0 

-1 

-1  - 

■6 

-3 

2 

8 

3 

0 

-1 

-1 

-6 

0 

0 

0 

0 

Add  -2  times  row  1  to  row  2 
Add  -3  times  row  1  to  row  3 

Add 

-1  times  row  2  to  row  3 

This  is  row  echelon  form. 

Write  the  corresponding  linear  system: 


—Xi  X2  3x^  =  3 

-  X2  -  xz  =  -6. 

There  are  two  equations  and  three  variables.  There  is  one  independent  variable.  Solve  for 
X2  in  terms  of  0:3  in  the  second  equation: 


X2 - Xz  +  6. 


Back  substitute  for  X2  in  the  first  equation; 

+  {—Xz  +  6)  +  3^3  =  3 
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— iCl  +  2^3 


3 


Xi  —  2^3  +  3. 

This  linear  system  has  infinitely  many  solutions.  The  genetal  solution  is: 

X\  ~  2s  “h  3 

X2  =  -s  +  6  ,  sis  a  scalar. 

Xs  =  s 


5.C. 


Augmented  Matrix 


■  -1 

1 

3 

3  ■ 

■  -1 

1 

3 

CO 

i 

1 _ 

1 

CO 

3  ■ 

-2 

1 

5 

0 

0 

-1 

-1 

-6 

0 

-1 

-1 

-6 

-3 

2 

8 

4 

0 

-1 

-1 

-5 

0 

0 

0 

1 

Add  -2  times  row  1  to  row  2 
Add  -3  times  row  1  to  row  3 


Add  -1  times  row  2  to  row  3 


This  is  row  echelon  form. 


The  augmented  matrix  has  a  row  [0  0  0  6  ] ,  6  ^  0;  therefore,  the  corresponding 


linear  system  is  inconsistent. 

Augmented  Matrix 


5.d. 


1 

0 

1 

3 

5  ■ 

■  1 

0 

1 

3  5  ■ 

■  1 

0 

1 

3 

5  ' 

-1 

-2 

0 

-3 

-9 

0 

-2 

1 

1 

0 

0 

-2 

1 

0 

-4 

2 

2 

1 

2 

18 

0 

2 

-1 

1 

00 

0 

0 

0 

-4 

4 

2 

1 

1 

5 

12 

0 

1 

-1 

-1  2 

0 

0 

-1 

0 

-1 

0 

Add  1  times  row  1  to  row  2 

Add  -2  times  row  1  to  rows  3&4 

Add  1  times  row  2  to  row  3 

Add  1/2  times  row  2  to  row  4 

Interchange  rows  3&4 

1 

0 

0 

0 


0 

-2 


0  f 
0  0 


3  5 

0  -4 
-1  0 
-4  4 


Xi 


+ 

2X2  + 


Xa  +  3x4 

xz 


-^xz 


X4 

4iX4 


5 

-4 

0 

4. 


This  is  row  echelon  form. 


This  linear  system  has  the  unique  solution: 

'  X4  =  6 

X2  =  3 

0:3  =  2 

^  X4  =  -1. 
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Augmented  Matrix 


5.e. 

'll!  9  ■ 

-2  -1  -1  -15 

’1119' 
0  113 

'll! 

0  1  1 

1 - 

CO 

-111-4 

0  2  2  5 

0  0  0 

1 

1 _ 

Add  2  times  row  1  to  row  2  Add  -2  times  row  2  to  row  3  Interchange  rows  3&4 

Add  1  times  row  1  to  rows  3 


This  linear  system  is  inconsistent. 


5.f. 


Augmented  Matrix 

12  11  7 

2  -8  2  2  -10 

2  3  2  2  12 

3-233  5 

Add  -2  times  row  1  to  rows  2&3 
Add  -3  times  row  1  to  row  4 


1  2  11  7 

0  -12  0  0  -24 

0  -100  -2 

0  -8  0  0  -16 

Add  -1/12  times  row  2  to  row  3 
Add  -2/3  times  row  2  to  row  4 


1 

2 

1 

1 

7 

0 

-12 

0 

0 

-24 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

This  is  row  echelon  form. 


{Xi 

2:3 

a;4 


3  —  s  —  t 
2 
s 
t. 


Augmented  Matrix 


'  1  0  2  5  ' 

'  1  0  2  5  ■ 

'  1  0  2  5  ■ 

2  3  5  5 

0  3  1-5 

0  3  1-5 

3  4  7  8 

0  4  1-7 

[o  0  ^ 

Add  -2  times  row  1  to  row  2  Add  -4/3  times  row  2  to  row  3  Multiply  row  2  by  1/3 

Add  -3  times  row  1  to  rows  3  3  3 


1 

0 

2 

5  ■ 

■  1 

0 

0 

3 

0 

1 

1 

3 

-5 

3 

0 

1 

0 

-2 

0 

0 

1 

1 

0 

0 

1 

1 

Add  -1/3  times  row  3  to  row  2  Multiply  row  2  by  1  /3 

Add  -2  times  row  3  to  row  1  Multiply  row  3  by  -3 


This  system  has  a  unique  solution 


6.b. 

'112  5 ■ 

' '2  5  7  19 

rsj 

'112  5' 
0  3  3  9 

'112  5' 
0  3  3  9 

2  4  6  16 

0  2  2  6 

0  0  0  0 

Add  -2  times  row  1  to  row  2&3  Add  -2/3  times  row  2  to  row  3  Multiply  row  2  by  1/3 
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‘1125]  ri012' 

0113~  0113  ,  This  system  has  infinitely  many  solutions. 

OOOOj  [0000 

Add  -1  times  row  2  to  row  1 

'  xi  =  2  —  s 

{  X2  —  “i  —  s  ,  s  is  a  scalar. 

^  =  s 

Augmented  Matrix 

'121  6]  ri216' 

6.C.  122  7  ~  0011  .  This  linear  system  is  inconsistent. 

242  15  ]  [0003 

Add  -1  times  row  1  to  row  2 
Add  -2  times  row  1  to  rows  3 

Augmented  Matrix 

■  -1  -2  -1  -5 1  r  -1  -2  -1  -5  ]  r  -1  0  1  -1 1  r  1  0  -1  1 

6.d.  1  3  2  7~  0  1  1  2~  oil  2~  01  12 

_2  4  2  10  j[0  0  0  0j[000  oj  [oo  00 

Add  1  times  row  1  to  row  2  Add  2  times  row  2  to  row  1  Multiply  row  1  by  -1 

Add  2  times  row  1  to  rows  3 

This  linear  system  has  infinitely  many  solutions: 

'  Xi  =  1  +  s 

i  X2  =  2  —  s  ,  s  is  a  scalar. 

^3  =  s 


7.  r  =  regular  beef,  d  =  diet  beef: 

.3r  +  .2d  =  3 
.7r  +  .8d  =  10 

Solve  for  d  in  the  first  equation: 

c?  =  15  —  1.5r 

Substitute  for  d  into  the  second  equation: 

.7r- +  .8  (15  -  1.5r)  =  10 
-0.5r  +  12  =  10 
-0.5r  =  -2 
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r 


4 


Back  substitute  for  r  to  solve  for  d  : 


d  =  15-1.5(4) 

=  9. 

The  butcher  should  make  4  pounds  of  regular  beef  and  9  pounds  of  diet  beef 

8.  No,  if  a  =  0  and  6  7^  0,  the  equation  becomes  0  =  6,  6  7^  0,  which  is  not  tme. 

9.  Consistent,  infinitely  many  solutions.  The  system  has  four  variables,  two  variables  are 
independent. 


10. a.  Reduced  row  echelon  form. 
lO.b.  Row  echelon  form. 

10. c.  Reduced  row  echelon  form. 

10. d.  Reduced  row  echelon  form. 

10. e.  Row  echelon  form 

lO.f  Neither.  There  is  a  row  of  zeros  not  at  the  bottom. 
lO.g.  Row  echelon  form. 


=  -21 

X2 

=  15/2 

X-i, 

=  23 

^2 

=  10 

Xl 

=  -2 

X2 

=  1 

% 

=  3 

ll.d.  Inconsistent 
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11. e. 


ll.f. 


Xi  = 

-15  +  2 

X2  = 

-1/25  +  3/2  , 

s  is  a  scalar. 

Xi  = 

15  +  0 

Xi  = 

^5-t  +  f 

X2  = 

s,  t  are  scalars 

Xi  = 

s  ’ 

— 

t 

ll.g.  Inconsistent. 


CHAPTER  TWO 

l.a.  (2x4)  (4x6)  =  (2x6) 
l.b.  (6x2)  (2x4)  =  (6x4) 
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l.c.  (2  X  4)  (6  X  2)  =  undefined, 
l.d.  (4  X  6)  (6  X  2)  =  (4  X  2) 
l.e.  (4  X  6)  (2  X  4)  =  undefined. 
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3.e. 


-2  11 
-5  5 


3.f. 


-2  11  ■ 
-5  5 


3.i.  -1,1 


3.j  S  does  not  have  a  main  diagonal  because  B  is  not  a  square  matrix. 


■  10  6  5  ■ 
4.b.  -4  5  3 

3  0  7 


■  -2  4  -1  ■ 

4.C.  -2  -5  -1 

-5  4  1 

27  25  28  ■ 

4.d.  -14  -5  -6 

8  1  13 

18  36  25  ■ 

4.e.  -21  -1  11 

-  91  26  18 


4.f. 


-21  -7  ■ 
0  14 
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4.g.  Undefined,  3(7  is  a  2  x  3  matrix  and  D  is  a  3  x  3  matrix. 


4.h. 


4.i. 


54 

108 

75 

-63 

-3 

33 

57 

78 

54 

-9 

18 

-33 

-3 

-18 

-31 

12  ■ 

-36 

34 

4.j.  Undefined,  (4B)  U  is  a  2  x  3  matrix  and  2fi  is  a  2  x  2  matrix. 


5. a. 


-6  -1  -8 
0  8-2 
4-6  7 


5.b.  Undefined,  >1  is  a  3  x  2  matrix  and  5  is  a  3  x  1  matrix. 


5.C. 


5.d.  5 


7 

-1 


6.a.  Undefined,  ^  is  a  2  x  3  matrix  and  (7  is  a  2  x  2  matrix. 


6.b. 


-20  -4 
0  10 


6.C.  —6 

6. d.  Undefined,  3£  is  a  3  x  1  matrix  and  B  is  a  3  x  2  matrix 

-c  J 

7. a.  False,  AB  is  a  3  x  1  matrix  and  BA  is  undefined. 

7.b.  True 
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7.C.  False,  matrix  multiplication  us  not  commutative. 


8. 

x-y 
X  ■  z 
X  ■  w 

y-  z 

y-w 
z  ■  w 

9. 

u  ■  w  — 
u  -  z  = 
w  •  z  = 


=  0 

orthogonal 

=  0 

orthogonal 

=  -4 

not  orthogonal 

=  65 

not  orthogonal 

=  0 

orthogonal 

=  38 

not  orthogonal 

0  orthogonal 

-1  COS0  =  101.10' 

0  orthogonal 


lO.a.  AB  is  undefined,  A  is  a  2  x  1  partitioned  matrix  and  5  is  a  2  x  1  partitioned  matrix. 


lO.b.  A  +  B  = 


” 

■  Ai' 

+ 

■  Bi  ■ 

'  Ai  +  Bi' 

A2 

B2 

A2  +  B2 

. 

-1 

3 


lO.c.  BC 


■  ■ 

B2 

[C]  = 

■  BiC  ' 
B2C 

i.  B2  is  a  1  X  3 

1  matrix  i 

Multiplication  is  undefined,  Bi  is  a  2  x  3  and  C  is 


matrix  and  C  is  a  1  x  3  matrix. 


ll.a.  [  ^2  ] 


Bi 

B2 


—  [AijBi  +  ^2^2]  = 


1  7 
6  10 


ll.b. 


Ai 

A2 


[Bi  B2]  = 


10  6 

-4  ■ 

AiB\  1  A\B2 

2  0 

-1 

A2B2  1  A2B2 

1  9 

1 

5  3 

-2 

All 

Ai2 

Bi  1 

AiiBi  +  A12B2 

A21 

A22 

B2  \ 

A21B1  +  A22B2 

7  ■ 

4 

Y 
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12. 


Day/Class 

Class  I 

Class  n 

Class  in 

Class  IV 

Monday 

1 

1 

0 

1 

Tuesday 

0 

1 

1 

0 

Wednesday 

1 

0 

1 

1 

Thursday 

0 

1 

1 

0 

Friday 

1 

0 

0 

1 

Class  I 

2  hours  /  session 

Class  n 

3  hours  /  session 

Class  m 

1  hour  /  session 

Class  IV 

3  hours  /  session 

Each  table  can  be  represented  by  a  matrix  and  multiplied. 

■  1  1  0  1 
0  110 
10  11 
0  110 
10  0  1 


2 

3 

1 

3 


8 

4 

6 

4 

5 


hours  on  Monday 
hours  on  Tuesday 
hours  on  Wednesday 
hours  on  Thursday 
hours  on  Friday 


13.  The  tables  can  be  represented  by  matrices  and  multiplied  together. 


3  1  1 

20 

missions  on  Monday 

2  2  1 

3 

25 

missions  on  Tuesday 

3  2  1 

8 

— 

28 

missions  on  Wednesday 

4  1  1 

3 

23 

missions  on  Thursday 

2  3  1 

33 

missions  on  Friday 

Two  workers  are  required  for  each  mission. 


■  20  ■ 

■  40  ■ 

workers  on  Monday 

25 

50 

workers  on  Tuesday 

28 

= 

56 

workers  on  Wednesday 

23 

46 

workers  on  Thursday 

33 

66 

workers  on  Friday 

14.  The  tables  can  be  represented  by  matrices  and  multiplied  together. 


50  45  60  ■ 

- 

200  250  200 

'2112' 

350  400  300 

12  11 

— 

50  45  60 

2  0  12 

265  ■  140  155  265 
1050  700  650  1050 
1700  1150  1050  1700 
265  140  155  265 
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The  budget  estimate  can  be  summarized  in  the  following  table: 


Annual  Training  Budget  Estimate  ($1,000.00) 


Expenses/Fiscal  Quarter 

1st  Qtr 

2nd  Qtr 

3rd  Qtr 

4th  Qtr 

Total  Annual  Expenses 

Equipment 

265 

140 

155 

265 

825 

Fuel 

1,050 

700 

650 

1,050 

3,450 

Repair  Parts 

1,700 

1,150 

1,050 

1,700 

5,600 

Meals 

265 

140 

155 

265 

825 

Total  Quarterly  Expenses 

3,280 

2,130 

2,010 

3,280 

10,700 

CHAPTER  THREE 


l.a. 


l.b. 


2. 


3. 


3  1 

-2  -3 
1  2 


Xi 

0  ■ 

X2 

-2 

.  . 

2 

0  4-12 

2  13  0 

4-1  2-3 


Xi 

X4 


5 

6 
2 


1  ■ 

2  ■ 

■  1  ■ 

8  ■ 

Xi 

3 

-1 

+  X2 

-1 

-2 

+  X3 

4 

'  0 

— 

8 

-6 

4. 


5.  Matrix  equation: 


^X\  -f-  Ax2  =  1 

X\  -\-  X2  =  2 

2xi  -j-  5x2  —  3 


Xi 

■  2  ■ 
1 

+  X2 

■  1  ■ 
2 

+  2:3 

3  ■ 
-1 

■  6  ■ 
2 

0 

3 

1 

4 
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need  to  solve  the  system  ciVi  +  C2V2  +  C3V3  = 


for  Ci,  where  i  =  1,2, 3. 


a 

b 


c 

d 


1 

-1 

1 

a 

■  1 

-1 

1 

a 

-1 

0 

0 

b 

row  equivalent  to 

0 

-1 

1 

a  +  b 

0 

1 

0 

c 

0 

0 

i 

<2  H-  6  “h  c 

0 

0 

-1 

d 

0 

0 

0 

d  b  c  d 

No,  the  vectors  vi,V2,V3  do  not  span  because  any  vector  of  the  form 


a  +  b  +  c  +  d  ^  0,is  not  in  Span{ui,U2,  ^4}  • 


o 

b 


c 

d 


9.  Solve  the  system  Ac  =  x  for  c. 


where 


2 

4 

-1 

5 

-5  ■ 
-3 

row  equivalent  to 

■  2 

0 

-1 

7 

-5  ■ 
7 

-3 

-2 

4 

0 

0 

0 

Xi 

X2 


-2 

1 


lifes,  X  is  in  the  plane  spanned  by  the  columns  o: 


A  because  the  corresponding  linear  system 


is  consistent. 


10.  Solve  the  linear  system  ciOi  4-  C2a2  +  c^az  =  b  for  c. 


2  0  1  3 

-4  3  0  -1 
4  3  4  2 


row  equivalent  to 


2  0  1  3 

0  3  2  5 

0  0  0  -9 


No,  b  is  not  in  Span{ai,  a2, 03}  because  the  corresponding  linear  system  is  inconsistent, 
ll.a.  3 
ll.b.  No 

11. c.  Solve  Ax  =  b  for  x. 


2 

-1 

3 

1  ■ 

■  2 

-1 

3 

1  ■ 

-5 

3 

-1 

8 

row  equivalent  to 

0 

1 

13 

21 

6 

-2 

4 

6 

0 

0 

-18 

-18 
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Yes,  b  is  in  W. 
ll.d.  Infinitely  many. 

11.  e.  la\  +  Oa2  +  Oas  = 

12.  a.  Solve  cix  +  C2y  =  a  for  c. 


'  ■ 

■  3  ' 

8 

.  ^3  . 

1 

4 

0 

1 

CO  1— > 

5  ■ 

-1 

row  equivalent  to 

1 

O 

-1 

3 

5  ■ 
-1 

-2 

5 

2 

Lo 

0 

12 

No,  a  is  not  in  Span{5,  y}  because  the  corresponding  linear  system  is  inconsistent. 
12.b.  Solve  Cix  +  c^y  =  b  for  c. 


4 

1 — 1 

1 

91 

■  4 

-1 

9l 

0 

3 

CO 

I 

row  equivalent  to 

0 

■  3 

CO 

1 

-2 

5 

-9j 

0 

0 

oj 

Cl 

2  ■ 

.  ^2 

-1 

— ^ 

'Vfes,  b  is  in  Span{x,  y}  . 

13  .a.  Rank  is  the  number  of  linear  independent  rows/columns  in  the  matrix.  Using  Gaussian 
elimination,  the  linearly  independent  rows  are  the  nonzero  rows  when  the  matrix  is  in  row 
echelon  form.  Rank(A)  =  3. 


■  1 

2 

0  ■ 

■  1 

2 

0  ■ 

3 

7 

-5 

row  equivalent  to 

0 

1 

-5 

4 

8 

5 

0 

0 

5 

13  .b.  One  way  to  answer  this  question  is  to  note  that  A  has  3  pivots;  therefore,  Ac  =  x  has 
a  unique  solution.  The  other  option  is  to  solve  Ac  =  x  for  c. 


■  1 

2 

0 

-1  ■ 

■  1 

2- 

0 

-1  ■ 

3 

7 

-5 

8 

row  equivalent  to 

0 

1 

-5 

11 

4 

8 

5 

-14 

0 

0 

5 

-10 

Cl 

■  -3  ■ 

C2 

= 

1 

.  ^3  - 

-2 
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Yes,  X  is  in  the  plane  spanned  by  the  columns  of  A. 
14.  Solve  Ax  =  b. 


■  7 

-2 

-5 

-6  ■ 

■  7 

-2 

-5 

-6  ■ 

3 

4 

1 

-14 

row  equivalent  to 

0 

34 

22 

-80 

0 

-6 

2 

20 

0 

0 

100 

100 

15.  a. 

15.b.  Ax  is  undefined. 
15. c. 


Xi 

■  -1  ■ 

X2 

-3 

.  ^3  . 

1 

Ax  = 


4a;  1  2x2  +  5x3 

—Xi  +  3X2  +  8x3 

2xi  +  X2  —  2x3 


Ax  = 


16. 


t 

r 

s 


T  (u)  =  Au 


17. 


T{v)  =  Av 


2 

0  ■ 

■  2  ■ 

■  2  0 

0 

2 

3 

and 

0  2 

4  ■ 

■  -2  ' 

6 

-6 

-1 

-3 


■  3 

-5 

-1 

-7  ■ 

■  3 

-5 

-1 

-7  ■ 

1 

2 

1 

14 

row  equivalent  to 

0 

11 

4 

49 

4 

0 

2 

24 

r 

“1  r- 

_  0 
■n 

0 

30 

120 

Xi 

■  4  ■ 

X2 

3 

.  ^3  . 

4 

X  IS  unique. 
18. 


7  0 
-5  1 
6  0 


3 
-3 

4 


1 

3 


0 

0 


-2  0 


row  equivalent  to 

r>j 


L. 

J 

rri 

L 

~l5 

3^2 

—  25 

^3 

25 

X4 

5 

7  0 
0  7 
0  0 


3 

-6 

10 


1  0 
26  0 
-20  0 


19. a.  a  =  6,  5  =  4 

19.b.  a  =  3,  5  =  5 
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19.  c.  a  —  4,  6  =  4 

20.  Find  an  x  whose  image  under  T  is  6. 


7 

0 

3 

1 

19  ■ 

■  7 

0 

3 

1 

19  ■ 

-5 

1 

-3 

3 

-10 

row  equivalent  to 

0 

7 

-6 

26 

25 

6 

0 

4 

-2 

12 

0 

0 

10 

-20 

-30 

Xi 

—s  +  4 

X2 

l-2s 

xz 

— 3  4"  2s 

X4^ 

s 

Ifes,  6  is  in  the  range  of  the  linear  transformation. 


21.  This  transformation  is  a  contraction.  Since  r  <  0,  the  transformation  also  points  the 
directed  line  segment  associated  with  the  vector  in  the  opposite  direction. 


■  -0.5 

0  ■ 

0 

-0.5 

-3 

-3/2 


■  -0.5  0  ■ 

■  -4  ■ 

2  ■ 

0  -0.5 

-1 

.  1/2  . 

22.  This  transformation  is  a  reflection  across  the  line  y  =  x. 


O 

t _ 

1  ■ 

1 

_ 1 

CO 

[1 

1 

o 

I 

CO 

_ 1 

1 

1 _ 

- 1 

o 

1 

1 _ 

1 - 

1 — 1 

1 

1 _ 

Li 

1 

o 

-1 

1 - 

1 

1 _ 

23. a. 


23  .b. 


T{u)  +  T{v) 
23.C. 


T  (x)  =  Ax  = 


Xi  —  2x2  +  3a;3 
2a;i  +xi  -  2xs 


T(u  +  v)  =T 


T{ru)=T 


rT  {u)  =  2 


/ 

6  ■ 

\ 

-4 

= 

■  20  ■ 

\ 

2 

J 

4 

10  ■ 

■  20  ■ 

2 

4 

+ 


-3 

13 


7 

15 
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23. d.  "^s,  the  transformation  is  linear  because 


T{u^v)  =  T{u)  +  T{v)  and T (rw)  =  rr (u) . 


24. a.  Rule: 


Domain:  B?.  Range;  R^. 
24.b.  Rule 


Domain:  Range:  R}. 


2xi  +  X2 
— Xi  -\-  3X2 
Xi  -  X2 
4X2 


Srci  -  2a;2  4-  4x3  +  2:4  ] 


r(«)  +  r(iO=[:i]  +  [:5]  =  [“J+;5 

Since  T{u  +  v)  ^T{u) +T  (v),  this  is  not  a  linear  transformation.  Domain:  R^.  Range 
R^. 


(Ml  +1^1 
U2  +V2 
M3  +M3 


2  (ui  +  111)  +  2  (u2  +  M2) 

(m1  +  Ml)  —  2  (u2  +  M2)  +  3  (Us  +  M3) 


T{u)+T{v)  = 


2ui  +  2m2  2mi  +  2m2 

Ml  —  2m.2  +  3M3  Ml  —  2m2  +  3M3 

2mi  +  2m2  +  2mi  +  2m2 
Ml  —  2M2  +  3M3  +  Ml  —  2m2  +  3M3 


/  r’Mi 
T  (ru)  =  T  I  ru2 
\  ruz 


2rux  +  2ru2 
rui  —  2ru2  +  3ruz 
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rT  (u)  =  r 


2'Ui  -|-  2'U2 

2rui  +  2ru2 

Ui  —  2^X2  "4"  3^X3 

ru\  —  2ru2  +  Zruz 

This  is  a  linear  transformation.  Domain:  Range:  B?. 


26.  a)T  ^ 

Xi 

X2 

Xi 

2Xi  +  0^2 

a)r( 

Xi 

_  2:2 

Xi 

2 

/ 

X2 

\ 

.  ^3  . 

Linear  transformation  Not  a  linear  transformation 


b)  Domain:  B?.  Range:  B^. 


b)  Domain:  B‘^.  Range:  B^ 


c)T 


4 

1 


d)A  = 


1  0 
2  1 
0  1 


4 

9 

1 


'  1  0  ■ 

A 

1 — 

1 _ 

e) 

2  1 

0  1 

4 

1 

■ 

9 

1 

d)  N/A  e)  N/A 


CHAPTER  FOUR 


1 

'31' 

'31' 

(2)(3)-(-l)(-5) 

.  ^  2 

5  2 

1 

■  1 

-2  ■ 

■  1 
f 

.  10 

-1  ‘ 
5 

(4)(l)-(2)(-3) 

3 

4 

2 

5  _ 

c-i  = 


0 

1 

2  . 


2.  A:  Add  -2  times  row  1  to  row  2. 
S:"Add  5  times  row  1  to  row  2. 
C\  Not  an  elementary  matrix. 

D:  Interchange  row  2  &  3. 

E:  Not  an  elementary  matrix. 
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F:  Add  1  times  row  2  to  row  4. 


Add  3  times  row  3  to  row  2 
Add  -3  times  row  3  to  row  1 
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6.  Solve  the  equation; 


Ly  =  b 

using  forward  substitution.  This  gives  us: 


We  obtain: 


Solve  the  equation: 


Ux  —  y 

using  backward  substitution.  This  gives  us: 


We  obtain: 


8.a.  Use  Gaussian  elimination  to  reduce  the  matrix  to  row  echelon  form  to  get  U.  Store  the 


negative  multiplier  in  L. 


'lOOl  r-2  4  3' 

210,  £/=  02-3 

.  -1  3  1  J  [  0  0  1 

8.b.  Use  Gaussian  elimination  to  reduce  the  matrix  to  row  echelon  form  to  get  U.  Store  the 
negative  multiplier  in  L. 


[lOOl  fs-ia' 

L=  310,U=0  4-1 

_ -4  2  1 J  [ 0  0-2 

8.C.  Use  Gaussian  elimination  to  reduce  the  matrix  to  row  echelon  form  to  get  U.  Store  the 
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negative  multiplier  in  L. 


1 

0 

0 

0  ■ 

i 

-2 

4 

1 

CO 

4 

1 

0 

0 

II 

0 

1 

5 

2 

-1 

2 

1 

0 

0 

0 

-1 

2 

1 

3 

-2 

1 

0 

0 

0 

-4 

8.d.  Use  Gaussian  elimination  to  reduce  the  matrix  to  row  echelon  form  to  get  U.  Store  the 
negative  multiplier  in  L. 


1 

o 

o 

1—1 

1 _ 

1 

to 

1 

— 1 

6  1  0 

II 

0  5  3 

4  3  1 

_  0  0-4 

9. a.  Expand  along  row  2. 


1^1  =  2 

4  2 

5  1 

1 

-3 

4  -1 

5  2 

=  2l 

[-6)- 

3(13) 

=  -12-39 
=  -51 


9.b.  Expand  along  row  1. 


=  2 

2  1 

-1  2 

-  1 

-1  1 

1  2 

+  1 

-1  2 

1  -1 

=  2(5) -1(- 

-3)  + 1  (-1) 

=  10  +  3-1 
=  12 


9. C.  Determinant  is  undefined  for  matrices  which  are  not  square. 

10.  a.  Reduce  A  to  row  echelon  form,  keeping  track  of  the  affect  of  row  operations  on  the 
determinant  of  the  resulting  matrix. 


1 

CO 

1 

t-H 

1 _ 

■  1  2  -3  ■ 

17-4 

0  5-1 

1 

LO 

1 

- 1 

0  0  1 

det  (A)  =  (1)  (5)  (1)  =  5. 
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lO.b.  Reduce  B  to  row  echelon  form,  keeping  track  of  the  affect  of  row  operations  on  the 
determinant  of  the  resulting  matrix. 


det  {B)  =  40 


det  (A)  =  90 

r  1  4  3  ■  ■ 

12. a.  The  determinant  of  the  matrix  —2  6  2  is  equal  to  60.  Since  the  determinant 

[  -3  -2  1  J 

is  not  equal  to  zero,  the  columns  of  the  matrix  are  linearly  independent. 

r  12-1] 

1 2.b.  The  determinant  of  the  matrix  11  1  is  equal  to  -5.  Since  the  determinant 

[-10  2  J 

is  not  equal  to  zero,  the  columns  of  the  matrix  are  linearly  independent. 

[  2  4  8  ] 

12.  b.  The  determinant  of  the  matrix  2  —6  —7  is  equal  to  0.  Since  the  determinant 

[  -2  2  1  J 

is  equal  to  zero,  the  columns  of  the  matrix  are  linearly  dependent. 

13.  a.  Compute  the  determinants  of  the  matrices  A,  Aib,  and  A^b. 


|A|  =  8 

Ai  b  —  —  24 
A^l^  =  8 


13. b.  Compute  the  determinants  of  the  matrices  A,  Ai6,  A^b,  and  A36. 

|A|  =  10 

A16  -  -60 

A26  =  30 

*3  [I 

A36  =  20 
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13. c.  Compute  the  determinants  of  the  matrices  A,  Aib,  A26,  and  Asb. 

|A|  =  -14 

Alb  =  -126 
A26  =  20 

Aab  =  -75 

9 

-10/7 

_  75/14 

13.d.  Compute  the  determinants  of  the  matrices  A,  Aib,  and  A2b. 

\A\  =  19 
Alb  =  57 
Aq  b  =  19 

^  r  57/19  1  r  3 

^  [  19/19  J  “  [  1 

13.e.  Compute  the  determinants  of  the  matrices  A,  Aib,  and  A26. 


1^1  =  -2 
Alb  =  —4 
A2b  =  2 


CHAPTER  FIVE 

l.a.  To  find  the  characteristic  polynomial,  calculate 

det  {A  —  XI) . 
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This  gives  us: 


2- A  5 
4  1-A 

=  (2 -A)  (1-A) -20. 
=  A^-3A-18. 


To  find  the  eigenvalues,  compute  the  roots  of  the  characteristic  polynomial; 

A^  -  3A  -  18  =  0 


This  equation  factors  into 

(A -6)  (A  +  3)  =  0. 

The  eigenvalues  are  Ai  =  6,  A2  =  —3.  Now  find  the  associated  eigenvectors  for  each 
eigenvalue  by  solving  the  homogeneous  system 


{A  -  XI)  x  =  0. 


For  Ai  =  6  we  obtain 


-4  5 

4  -5 


Xi 

X2 


0 

0 


We  find  that  one  variable  is  free.  Let  x-i  =  s,  and  Xi  =  js. 
Ai  =  6  is  X  =  s  ,  s  7^  0. 

For  Ai  =  —  3  we  obtain 


We  find  that  one  variable  is  free. 
-1 


he  eigenvector  associated  with 


■55' 

Xi  ' 

■  0  ■ 

4  4 

X2 

0 

i.et  X2  — 

t,  anda^i  = 

=  —t. 

Ai  =  6  is  ^  =  t 


,  t  0. 


l.b.  To  find  the  characteristic  polynomial,  calculate 

det  [A  —  XI) . 

This  gives  us: 


3- A  -5 
0  2-A 
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=  (3-A)(2-A) 

=  A^-5A  +  6. 

To  find  the  eigenvalues,  compute  the  roots  of  the  characteristic  polynomial: 


A^  -  5A  +  6  =  0 


This  equation  factors  into 

(A  -  3)  (A  -  2)  =  0. 

The  eigenvalues  are  Ai  =  3,  A2  =  2.  Now  find  the  associated  eigenvectors  for  each  eigen¬ 
value  by  solving  the  homogeneous  system 


{A  -  XI)  0. 


For  Ai  =  3  we  obtain 


1 

LO 

1 

0 

Xi  ' 

■  0  ■ 

[0  -1  J 

X2 

0 

X  =  s 


0 

1 


,s^0. 


For  Ai  =  2  we  obtain 


■  1  -5  ■ 

Xl 

■  0  ■ 

0  0 

0 

We  find  that  one  variable  is  free.  Let  X2  — 

r  ^  n 

t,  and 

Xl  = 

5t  ' 

Ai  =  2  is  t 


5 

1 


l  .c.  To  find  the  characteristic  polynomial,  calculate 


det  {A  -  XI) . 


This  gives  us; 

3-A  0  0 

1  -A  4 

2  0  1  -  A 
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(3 -A) 


-A  4 
0  1-A 


=  (3  -  A)  (-A)  (1  -  A) 

=  -A®  +  4A^  -  3A 

To  find  the  eigenvalues,  compute  the  roots  of  the  characteristic  polynomial; 

-A^  +  4A2  -  3A  =  0 


This  equation  factors  into 

-A  (A -3)  (A  -  1)  =0. 

The  eigenvalues  are  Ai  =  0,  A2  =  3,  A3  =  1.  Now  find  the  associated  eigenvectors  for  each 
eigenvalue  by  solving  the  homogeneous  system 

{A-XI)x  =  0. 


For  Ai  =  0  we  obtain 


I 

0 

0 

CO 

1 _ 

■  xi  ■ 

■  0  ■ 

1  0  4 

X2 

= 

0 

2  0  1 

Xs 

_  0. 

We  find  that  =  0,  a;3  =  0  and  X2  is  free. 

r  _  1 

Let  X2  = 

s.  T 

0 

Ai  =  0  is  ^  =  s  s 
_  0 

For  A2  =  3  we  obtain 


eigenvector  associated  with 


,  s  ^  0. 


We  find  that  one  variable  is 
sociated  with  A2  =  3  is  x  =  t 


■  0  0  o' 

Xi 

■  0  ■ 

1  -3  4 

X2 

0 

2  0-2 

X3 

0 

free.  Let  0:3  =  t.l 

’hen  Xi  =  t  and 

as- 


1 

5/3 

1 


,  t  7^  0. 


For  A3  =  1  we  obtain 


1 

0 

0 

CN 

1 _ 

Xi 

■  0  ■ 

1  -1  4 

X2 

0 

2  0  0 

.  ^3  . 

0 
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We  find  that  xi  =  0.  One  variable  is  free.  Let  =  r.  Then  x^  =  4r.  The  eigenvector 

■  0  1 

associated  with  A3  =  lisx  =  r  4  ,r7^0 

1  J 

l.d.  The  characteristic  polynomial  is:  —  +  6A^  —  5A.  The  eigenvalues  and  associated 

—  1/5X2  2X3 

eigenvectors  are  Ai  =  0,  Xj  =  X2  ,  A2  =  5,X2  =  0  ,  A3  =  1, 

2/5x2  X3 


l.e  The  characteristic  polynomial  is:  -A^  +  2A^  +  5A  -  6.  The  eigenvalues  and  associated 

0  —3/2x3 

eigenvectors  are  Ai  =  1,  xj  =  0  ,  A2  =  -2,X2  =  0  ,  A3  =  3, 

L  .  ^3 

2X2 

X3  =  X2  . 

2X2 

l.f.  The  characteristic  polynomial  is:  —  A^  —  7A^  +  12A^.  The  eigenvalues  and  asso- 

r  oi  r  oi 


dated  eigenvectors  are  Ai  =  0,  :ri  =  ^  ,  A2  =  0,^2 

^3 

0 


,  A3  =  3, 


-4/3x4  ’  ^4 -4,  ^4- 


2,  A  —  2  is  an  eigenvalue  of  2  3  there  is  a  vector  x  which  satisfies  the  equation 


This  gives  us 


which  can  be  rewritten 


4 1 1  r  1  ^  9  [ 

2  3  X2  X2 


4xi  +  X2  =  2xi 
2xi  +  3x2  =  2x2. 


2x]^  -|-  X2  —  0 
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2xi  -|-  X2 


0. 


1 

-2 


This  is  a  system  with  one  equation  and  two  variables.  Let  Xi  =  t.  x  =  t 
we  found  a  vector  which  satisfies  the  equation,  we  say  A  =  2  is  an  eigenvalue  of 
with  associated  eigenvector  =  t 


3. 


1 

4 


is  an  eigenvector  of 


1 

-2 
6  2  ■ 
3  1 


.  Since 

4  1 
2  3 


if  there  is  a  scalar  A  which  satisfies  the  equation 


6  2 
3  1 


This  gives  us 


^  J  is  not  an  eigenvector  of 
4.  18+2i 


6  2 
3  1 


1 

4 


5.  3+3i 

r  (2-2i)(3-q  _  4-8i  _  2  4  • 

•  (3+i)(3-i)  10  5  5* 

7.  (2  -  42)  (3  +  6i)  =  30 

o  (6-j)(l+2i)  _  (8+lH)(5-3z)  _  73+31t  _  73  ,  31  ■ 
(4-i)(H-i)  (5+3i)(5-3i)  34  34  34* 

9.  2®  +  3*2  -  4  =  -2  -  3  -  4  =  -7  -  2 


10.  v/9  +  16  =  =  5 

11.  \/25T4  = 

12. a.  e  =  - 

4 

12.  b.  I^l  =  \/^  =  4^/2,  z  =  4-\/^  ^cos  ^  "h  *  sin 

13.  a.  (0  +  42)  (2  -|-  22)  =  — 8  +  82 

13.b.  |2;|=4,  |2i;|  =  2v^,  axg{z)  =  ^,  &ig{w)  =  -. 

2  4 


A  /  .  .  TTN 

z  =  4(^cos-+2sm-j  , 
w  =  2V2  ^cos  —  +  2  sin  . 
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13.C. 


13.d. 


zw  = 


8V2 


/  Stt  ,  .  37r\ 

cos  —  +  z  sin  — 

V  4  4j 


{4i)^  =  64i^  =  —6Ai 


13.e. 


/  =  4^ 

14. a.  z  =  2  +  4i,  \z\  =  =  2\/5,  arg  (z)  =  tan”^  2, 


Stt  Stt 

cos  —  + 1  sm  — 
z  z 


) 


z  =  2V5  (cos  (tan  ^  2)  +  ^  sin  (tan  ^  2)  ) 


14.b.  z  =  4  —  i,  |z|  =  -s/l?,  arg  (z)  =  tan  ^  (“^)  , 


14. c.  z  =  6  +  3i,  |z|  =  \/45  =  3-\/5,  arg  (z)  =  tan  ^  (|) 


15.  z  =  — +  ^/2^ 

16.  z  =  104.  This  means  z^  =  16.  In  polar  form 

z^  =  16  (cos  0  +  *  sin  0) . 

We  want  to  find  the  fourth  roots  of  z^,  or  (z^)^  . 

z  =  104  ^cos  ^  (0  +  2k7r)  4-  ^  sin  ^  (0  +  2A:7r)^  ,  k  =  0,1,2, 3. 
For  A:  =  0,this  takes  on  the  value 


2  (cos  0  +  i  sin  0)  =  2. 


For  fc  =  1 ,  this  takes  on  the  value 


/  27r 

.  .  27r\ 

.  .  7r\ 

cos  — 

+  ^sm  — 

=  21  cos  — 

+  z  sm  —  ) 

V  4 

4  J 

V  2 

2) 
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For  A:  =  2,  this  takes  on  the  value 


2  (cos  TT  +  i  sin  tt)  =  —2. 


For  k  =  3,  this  takes  on  the  value 


/  3tt  .  ,  37r\ 

^  I  cos  —  +  ^  sm  —  1  =  —2i. 


17. a.  e2+*2  =  62  (cos  I  +  isin|)  =  62  (0  +  i)  =  ie^ 

17. b.  =  6^  (cos  (—5)  +  i  sin  (~5))  =  cos  (—5)  +  ie^  sin  (~5). 


18. a.  Ai  =  4e*2 


18.b.  l+i  =  ^/2e^f 

-C  =  \z\  =  1/1  =i,  0  =  tan“^  -v/S  = 


27r  .  .  27r 

z  =  cos  « sin  — 
o  o 

1  /  1  /27r  ^  \  .  .  1  /27r 


For  A;  =  0,  this  takes  on  the  value 


A;  =  0,1 


,l  (Ij  +  i  (|ij  j  5 + ”“|)  =  5 + 


1  ,  -V^ 

//  Zi 


For  A:  =  1,  this  takes  on  the  value 


1  /27r  \  .  .  1  /27r 

coS5l-  +  2,rj+ts.n5(-+2,r 


1  ( 3'k\  .  .  1  /Stt' 

'=“2(t)+‘"”5  T 


(  An  ,,  Att 

=  I  cos  —  +  2  sm ' — 

\  O  O 


-1  .V3 

2  “*T 


20.  z  =  1  =  (cos  0  +  *  sin  0) 


zi  =  ^cos^(2k7r)+ism^(2k7r)'^  ,  A:  =  0,1, 2, 3, 4, 5. 


For  A:  =  0,  this  takes  on  the  value 


cos  0  +  z  sin  0 
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For  A:  =  1 ,  this  takes  on  the  value 


For  A:  =  2,  this  takes  on  the  value 


'K  .  .  TT 
COS  —  + 1  Sin  — 

O  O 


2n  .  .  2tx 
cos  —  +  ^  sm  — 
o  o 


For  A;  =  3,  this  takes  on  the  value 


cos  TT  +  i  sin  TT 


For  A:  =  4,  this  takes  on  the  value 


For  A:  =  5,  this  takes  on  the  value 


47r  .  .  47r 

cos  —  +  *  sm  — 
o  o 


Stt  .  .  Stt 
cos  —  +  ^  sin  — 

O  o 


21.  Ai  =  2i,  X  =  X2 

22.  Ai  =  — 1  +  x  =  X2 


—1  —  i 
1 

— 3~|~^ 


,  A2  =  — 2i,  X  =  X2 


—l+i 
1 

-3-i 


®  ,  A2  =  -l-i,  X=X2 


5 

1 
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